TACC / autodock-vina-app

0 stars 4 forks source link

Limit search time so all jobs finish within wallclocklimit #4

Open wjallen opened 1 year ago

wjallen commented 1 year ago

If a job hits the wallclocklimit, then likely it has not finished docking all the ligands or removing all the output that it doesn't need to keep. This creates a problem where TAPIS will then try to archive all the output files (could be 3M+ files) to the archive location. This is not ideal.

We should either be deleting temporary output files as we go, or reserving time at the end of the job for cleaning up.

wjallen commented 1 year ago

Maybe one way to approach this is to do the search outside of the Tapis directory? E.g. if we put all intermediate files on /tmp, then tapis won't try to archive those. /tmp on Lonestar6 is ~275 GB