mozilla-ai / lumigator

Source code for Mozilla.ai's Lumigator platform
https://mozilla-ai.github.io/lumigator/
Apache License 2.0
63 stars 7 forks source link

/jobs is able to return an up to date job status #382

Open ividal opened 4 days ago

ividal commented 4 days ago

Describe the bug The API has an endpoint apparently able to return the status of a job (/jobs/{job_id}) but this status is not updated beyond "created". Currently one has to poll ray directly, which is not ideal.

System Information (please complete the following information):

To Reproduce Steps to reproduce the behavior, via the API:

  1. Upload a dataset
  2. Launch a job (e.g. evaluation with bart)
  3. List jobs, find the job_id of one (e.g. the one you just created)
  4. get /jobs/{job_id} --> created
  5. Check on the ray dashboard until that job has finished
  6. get /jobs/{job_id} --> still created

Expected behavior Since these jobs are async, "finished" as a status when the job is done.