search

xenon-middleware / xenon-cli

Perform files and jobs operations with Xenon library from command line
http://nlesc.github.io/Xenon/
Apache License 2.0
2 stars 3 forks source link

Suggestion: local adapter: use submit instead of exec #77

Open fgvieira opened 3 years ago

fgvieira commented 3 years ago

Would it be possible for the local adapter to use submit instead of exec? This way, one could have the command:

"xenon scheduler $XENON_SCHEDULER --location local:// submit --working-directory . {threads} {mem} {walltime} {extra_args}"

and only change $XENON_SCHEDULER to select where to run it.

The local adapter also does not support the --location option. Are any plans to support it? This way it would be possible to run jobs "locally" on remote machines through (e.g.) SSH.

sverhoeven commented 3 years ago

The local (and ssh) scheduler adaptor can not remember job states between different calls to xenon-cli. So you can not do submit and then later wait for it.

You can use the at scheduler adapter, to submit jobs locally. The at adapter also support --location with local:// orssh://host`.

You will need to install at on your operating system.

fgvieira commented 3 years ago

That seems to do the trick! Getting an error about at adaptor: Unsupported maximum runtime: 600, but that is probably another issue.

Thanks!

fgvieira commented 3 years ago

It seems that the at adaptor does not support --max-run-time. To make it compatible with the other adaptors, would it be possible for the adaptor to just ignore this option (and maybe give a warning)?