search

MWATelescope / giant-squid

An alternative MWA ASVO client
Other
6 stars 1 forks source link

submitting jobs should be able to continue after the failure of a single job. #23

Closed d3v-null closed 2 months ago

d3v-null commented 3 months ago

let's say a user submits a list of obsids in a file called $obslist like this:

giant-squid submit-conv --parameters=$params $obslist

but a handful of those fail for some reason, so the user wants to resubmit those jobs that failed. They re-run the above command, but it bombs out as soon as it reaches an obsid that didn't fail, because that obsid already exists.

Error: The server responded with status code 400 Bad Request, message:
{"error": "Job already queued or processing.",  ...

Giant-squid then stops iterating through $obslist.

There should be a way for giant-squid to continue submitting the other obsids.

This is the current way to work around this:

cat $obslist | while read obsid; do 
  giant-squid submit-conv --parameters=$params $obsid; 
done