vineetbansal / wbi

0 stars 0 forks source link

Make temporary file creation more robust #8

Open vineetbansal opened 11 months ago

vineetbansal commented 11 months ago

The temporary folder selected by wbi.remote is /scratch/gpfs/{username}/tmp. This is arbitrary and unlikely to work for any new user. In fact it's better to not have to specify any temporary folder at all (on the command line or config file or hardcoded), but have a solution that runs in all cases.

On Della, /tmp is writable, but looks like slurm jobs don't output to /tmp correctly (needs more investigation needed).

In any case, running tempfile.NamedTemporaryFile() locally and using the returned name on a different system is fraught with danger, so a better solution is needed here.