camall3n / onager

Lightweight python library for launching experiments and tuning hyperparameters, either locally or on a cluster
MIT License
20 stars 4 forks source link

configuration for location of output file and error file #40

Open zhouzypaul opened 3 years ago

zhouzypaul commented 3 years ago

It would be nice if the user can specify a customized location of where the output file and error file goes to, which overwrites the default location .onager/logs/.

This would come in handy when it comes to the CS file system, for example, when the jobs can write to the local disk /ltmp instead of the shared file system, which makes i/o much faster.

In this case, if might also be useful if onager can automatically create the specified output directories if it doesn't exist (for example, if one tries to save to /ltmp/some_sub_directory/test_job.e, the job will hit Eqw since the directory doesn't exist on the specific gridengine node.