Known issues

[nassiharel]

FlowInput

• ** when flowInput is null**

{
  "name": "flowInputIsNull",
  "nodes": [
    {
      "nodeName": "eval-alg",
      "algorithmName": "eval-alg",
      "input": [
        "@flowInput.inputs"
      ]
    }
  ],
  "flowInput": {
       "inputs": null
  }
}

trying to send this pipeline (/exec/raw) will result with:

{
  "error": {
    "code": 400,
    "message": "unable to find flowInput.inputs"
  }
}

Pipelines Triggers

• No validation for cyclic triggers.
• Using the jobId key to specify the pipelines dependencies.
• ** Storing this pipeline and then run it:**

{
  "name": "simple",
   "nodes": [
    {
      "nodeName": "green",
      "algorithmName": "green-alg",
      "input": [
        "files.link"
      ]
   }],
  "triggers": {
    "pipelines": [
      "simple"
    ]
  }
}

will result with this jobId like this, until api-server error (XMinioInvalidObjectName):

simple:f51ebc86-4c02-4cf9-9c67-78786f4f2064.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple.simple

Low TTL

• ** Low TTL (1-5 minutes) will not work due to the large (5 minutes) interval of the pipeline cleaner**

{
  "name": "lowTTL",
  "nodes": [
    {
      "nodeName": "eval-alg",
      "algorithmName": "eval-alg",
      "input": [
        null
      ],
      "extraData": {
        "code": [
          "(input) => {",
          "return new Promise((resolve,reject) => {",
          	"setTimeout(() => ",
          	   "resolve(4)",
          	",120000)",
             "});",
           "}"
        ]
      }
    }
  ],
  "options": {
    "ttl": 10
  }
}

Cache API

• ** The cache API not working properly **

{
  "name": "checkTheCache",
  "nodes": [
    {
      "nodeName": "green-alg",
      "algorithmName": "green-alg",
      "input": [
        null
      ]
    },
     {
      "nodeName": "yellow-alg",
      "algorithmName": "yellow-alg",
      "input": [
        "@green-alg"
      ]
    }
  ]
}

Trying to run one node will return the following error:

"error":{
   "code":400,
   "message": "pipeline name must contain only alphanumeric, dash, dot or underscore"
 }

The cache API creates pipeline name with the : sign

• Pipeline with custom input is not working

"nodeName": "node3",
"algorithmName": "eval-alg",
"input": [
               {"a": "@node1"},
               {"b":"@node2"}
           ]

Exec raw/stored

• We are exposing the triggers property but it has no meaning.
  We are looking at the stored pipelines only. (need to remove it from the swagger schema)

Worker

• need to expose the errors from storageManager put function.
• need to clean the etcd key on exit (/workers/).
• in some cases, when we do storage-get we get this error:

{
    "errno": -5,
    "code": "EIO",
    "syscall": "open",
    "path": "/hkubedata/pub-hkube/<jobId>/<jobId>"
}

Jobs Graph

• Add redis graph cleaner

ReadMe API

• Most of these API functions aren't working, also there are no tests
• When we delete pipeline we should also delete the readme

Jaeger

• tracing can be very very big (more than 30 sec to fetch) need gzip
• tracing is truncated in big batch

Logs

• Simulator logs are at Pod level, not the algorithm level.