search

lanl / BEE

Other
14 stars 3 forks source link

Flux support #696

Closed jtronge closed 11 months ago

jtronge commented 1 year ago

This should add initial flux support to bee along with a pennant scalability workflow.

jtronge commented 1 year ago

I've added some initial CI testing for flux. It's taking about 14 minutes to run (versus about 8 for the Slurm version).

pagrubel commented 12 months ago

This looks good. The example needs to be scrubbed some. You shouldn't refer to actual cluster it was tried on and if you are going to keep the example in the examples directory, some instructions should be included in the documentation.

jtronge commented 11 months ago

I scrubbed the pennant workflow and moved it to the beeflow data directory.

There seems to be a strange dependency error happening in CI and I don't think it's related to my changes. I'm going to try a couple updates to fix that.

jtronge commented 11 months ago

I updated the PyYAML version and this seems to have fixed the CI tests. Looks like they just made a new release on July 17, although I'm not sure if this is exactly what caused poetry problems.