libAtoms / ExPyRe

Execute Python Remotely
GNU General Public License v2.0
4 stars 3 forks source link

Enable running jobs in rundir even if host = None #32

Closed bernstei closed 9 months ago

bernstei commented 9 months ago

Fix bug where having host = None caused rundir to be ignored, and all jobs run directly from stage dir. Now rundir = None (and host = None) will cause this behavior, but specifying a value should stage to rundir (e.g. a scratch directory). This will still result in two extra copies, just like a real remote job - one from original to stage, one from stage to rundir (except that this is local, not remote).

Add local_stage_dir key to top level of config.json. Makes it possible to set the stage dir to scratch, which (with host None and no rundir) makes it stage to scratch and then run directly there.

Redo the way the root directory and config.json are searched and used to determine the final config info, so subdirectories can override the local_stage_dir key.

closes #31