If a job hits the wallclocklimit, then likely it has not finished docking all the ligands or removing all the output that it doesn't need to keep. This creates a problem where TAPIS will then try to archive all the output files (could be 3M+ files) to the archive location. This is not ideal.
We should either be deleting temporary output files as we go, or reserving time at the end of the job for cleaning up.
Maybe one way to approach this is to do the search outside of the Tapis directory? E.g. if we put all intermediate files on /tmp, then tapis won't try to archive those. /tmp on Lonestar6 is ~275 GB
If a job hits the wallclocklimit, then likely it has not finished docking all the ligands or removing all the output that it doesn't need to keep. This creates a problem where TAPIS will then try to archive all the output files (could be 3M+ files) to the archive location. This is not ideal.
We should either be deleting temporary output files as we go, or reserving time at the end of the job for cleaning up.