kube-HPC / hkube

🐟 High Performance Computing over Kubernetes - Core Repo 🎣
http://hkube.io
MIT License
303 stars 20 forks source link

"#@input" wont work with another list in input #1893

Open riegerben opened 4 months ago

riegerben commented 4 months ago

Bug in list node output (#@) In the example pipeline json, print-and-return-1 will be triggered 3 times (as expected). print-and-return-2 input have another list, so it will be tiggered only once and it's input will be:

[{
  "thelist": "#@flowInput.thelist",
  "anotherlist": [
      4,
      5,
      6
  ]
}]

pipeline json:

{
    "name": "hashtag-bug-test",
    "description": "hashtag bug test",
    "nodes": [
        {
            "nodeName": "print-and-return1",
            "algorithmName": "print-and-return",
            "input": [
                {
                    "thelist": "#@flowInput.thelist"
                }
            ],
            "kind": "algorithm"
        },
        {
            "nodeName": "print-and-return2",
            "algorithmName": "print-and-return",
            "input": [
                {
                    "thelist": "#@flowInput.thelist",
                    "anotherlist": [
                        4,
                        5,
                        6
                    ]
                }
            ],
            "kind": "algorithm"
        }
    ],
    "flowInput": {
        "thelist": [
            1,
            2,
            3
        ]
    },
    "triggers": {
        "cron": {
            "pattern": "2-59/6 * * * *",
            "enabled": false
        }
    },
    "options": {
        "batchTolerance": 100,
        "concurrentPipelines": {
            "rejectOnFailure": true,
            "amount": 1
        },
        "progressVerbosityLevel": "info",
        "ttl": 660
    },
    "priority": 3,
    "experimentName": "main",
    "kind": "batch"
}

I think it happens not only with lists, with dict too.