radical-cybertools / radical.pilot

RADICAL-Pilot
http://radical-cybertools.github.io/radical-pilot/index.html
Other
54 stars 23 forks source link

flux partitioning #3137

Closed andre-merzky closed 3 months ago

andre-merzky commented 7 months ago

We see a flux task throughput rate of about 5 tasks per second (see #3122). In order to improve overall task throughput, we should use multiple concurrent flux instances, each started via it's own srun.