search

jtracker-io / jt-cli

JTracker Command Line Interface
Apache License 2.0
2 stars 1 forks source link

Prevent submission of the same job for the same workflow #18

Closed junjun-zhang closed 6 years ago

junjun-zhang commented 6 years ago

The idea is to prevent users from accidentally submitting same job file for the same workflow. Usually it is undesired to queue the same job twice. However in some corner cases, it might be necessary so we need a way to allow user force it.

The other point is that what makes it the same job. There are two options: 1) use a unique user-defined job name with semantic meanings to represent a unique piece of compute; 2) use content-driven checksum to represent unique piece of compute. Based on our experience, option 1 works well for our use cases.

junjun-zhang commented 6 years ago

Issue moved to jtracker-io/jt-jess #18 via ZenHub