keenon / AddBiomechanics

A tool to automatically process and share biomechanics data
https://addbiomechanics.org/
Other
26 stars 5 forks source link

Scale SLURM resources to size of input files #204

Closed keenon closed 10 months ago

keenon commented 10 months ago

Currently we have a hardcoded amount of resources requested for every processing job. Smaller jobs would benefit from faster queueing times if we asked for smaller amounts of resources for them. It would be nice to make this line have just a tiny bit of logic to select the size of resources we want dynamically based on the size of the input files: https://github.com/keenon/AddBiomechanics/blob/c04dd9e3d434fccd7840582abfacda2772db0181/server/app/src/mocap_server.py#L704