VEuPathDB / lib-compute-platform

Async compute platform core.
1 stars 0 forks source link

Workspace deletion/expiration checks when executing an async job. #39

Closed Foxcapades closed 1 year ago

Foxcapades commented 1 year ago

Description

Adds checks to the async platform's job execution that ensure the job's workspace is in a valid state before the job is executed, after the job is executed but before anything is written to S3 (MinIO), and after the job's result files are written to S3 (MinIO).

If the workspace is found to be deleted or expired before the job is executed, the job will be "aborted" without execution.

If the workspace is found to be deleted or expired after the job is executed but before anything is written to S3 (MinIO) the job will be "aborted" and nothing will be written to S3 (MinIO).

If the workspace is found to be invalid after the job's result files were written to S3 (MinIO) the workspace will be wiped entirely and the job will be "aborted".

"Aborted" in this context means to complete without the standard binary completion status of Success/Failure. No completion notice is sent for an aborted job.

PR Checklist