kube-HPC / hkube

🐟 High Performance Computing over Kubernetes - Core Repo 🎣
http://hkube.io
MIT License
305 stars 20 forks source link

Show batch node indication in pipeline defention and job berfore node actually ran. #1848

Closed golanha closed 5 months ago

golanha commented 8 months ago

Show batch node indication in pipeline defention and job berfore node actually ran.

  1. In pipeline deffintion determine if node is batch: a. For streaming pipeline check the stateType, stateless should apear as batch. b. For batch pipeline, check the nodes input, if any of its input begin with # , then the node should apear as betch.

  2. For the running jobs also check the pipeline and set batch nodes according to the same rules as pipeline defention.