search

icecube / flarestack

Unbinned likelihood analysis code for astroparticle physics datasets
https://flarestack.readthedocs.io/en/latest/?badge=latest
MIT License
8 stars 7 forks source link

Transition `DESYSubmitter` to `HTCondor` #219

Closed JannisNe closed 1 year ago

JannisNe commented 2 years ago

This is not a bug yet but will be at the end of the year. The DESY frame will transition from gridengine to HTCondor so the DESYSubmitter will stop working. Fortunately the WIPACSubmitter is already set up to use HTCondor so it will not be much work to mimic that for DESY. I will be working on this here and open a pull request asap.

mlincett commented 2 years ago

Thank you. Wanted to open an issue about this but nice to see you are already on it!

mlincett commented 1 year ago

Thanks @JannisNe for working on this. I am willing to test this branch and see what's left to do. Can you comment on the current state of progress?

mlincett commented 1 year ago

After a chat with @JannisNe it seems all is in place. We just need a better strategy to deal with log files.

I suggest to drop the following from flarestack/cluster:

mlincett commented 1 year ago

I have adjusted the log paths so the log/err/out files are created under the flarestack scratch dir as initially intended.

Since for WIPAC it is not recommended to create HTCondor logs on network storage, I decoupled the path of log files from the one of out/err, so the former is overridden in WIPACSubmitter.

Everything should be ready.