Get simulator to store job outputs on Azure - Githubissues

alan-turing-institute / simulate

A web framework for research simulations.

http://simulate.readthedocs.io

MIT License

4 stars 1 forks source link

Get simulator to store job outputs on Azure #55

Open nbarlowATI opened 6 years ago

nbarlowATI commented 6 years ago

Goal

Get simulator to store job outputs on Azure.

Acceptance criteria

Simulator (openfoam) knows when job is complete.
Performs PATCH {status: cleanup} (rename to 'finalizing'?) request to job-manager's 'job//status' endpoint, and retrieves a SAS token.
zips output dir and stores as a blob on Azure.
returns URI to job-manager via PATCH request

Implementation notes

simulator needs azure cli tools installed (add to Dockerfile)
how does the simulator know the job_id ? Search it's own directory path?
how does the simulator know the container_name to put the blob into? Another output of the PATCH request to job manager?
- who creates the container? the job manager or the simulator? does the container name contain the job_id, or is that just part of the blob name?