i-VRESSE / bartender

Middleware web service to schedule jobs on various infrastructures
https://i-vresse-bartender.readthedocs.io
Apache License 2.0
1 stars 0 forks source link

Do not unpack uploaded archive in route handler #14

Open sverhoeven opened 2 years ago

sverhoeven commented 2 years ago

Now the uploaded archive file is unpacked in the route handler method. When the uploaded file is very big this can cause timeouts for the http response.

It would be nice if the unpacking could be done in by in the background. Some scheduler could be required to stage the archive on some remote filesystem , we can skip doing local (for web service) unpacking.

It would also be nice if the archive could be checked to contain the config file without unpacking it. To prevent submitting a job that is known to fail.