Closed camallen closed 2 years ago
Provide job monitoring feature (celery background worker?) to monitor submitted Zoobot batch jobs.
These would track the job state and update as the jobs complete / error.
Also look at adding a polling job status API for requesting this data (via long polling). Similar batch job monitoring code via Azure Cosmos at https://github.com/zooniverse/CameraTraps/blob/master/api/batch_processing/api_core/server_batch_job_manager.py#L127
we're using the azure batch job resources / API as the job tracking store.
Provide job monitoring feature (celery background worker?) to monitor submitted Zoobot batch jobs.
These would track the job state and update as the jobs complete / error.
Also look at adding a polling job status API for requesting this data (via long polling). Similar batch job monitoring code via Azure Cosmos at https://github.com/zooniverse/CameraTraps/blob/master/api/batch_processing/api_core/server_batch_job_manager.py#L127