Flux has been a necessary component for the scheduling and execution of MPI workflow tasks. This is because Parsl's support for MPI was not suitable when this project was started. However, in the last few months Parsl has been updated to include MPI support in their standard HTEX executor. Support for MPI is also expected soon for Globus Compute. While native support for MPI is being developed fro Globus Compute, we can launch remote MPI tasks with Globus Compute by wrapping them inside Parsl workflow programs that use Parsl's MPI support.
Flux adds considerable complexity to the software stack to support, and numerous headaches with its installation have slowed development. Therefore Flux should be removed and tests transitioned to Parsl's MPI support as soon as possible.
Flux has been a necessary component for the scheduling and execution of MPI workflow tasks. This is because Parsl's support for MPI was not suitable when this project was started. However, in the last few months Parsl has been updated to include MPI support in their standard HTEX executor. Support for MPI is also expected soon for Globus Compute. While native support for MPI is being developed fro Globus Compute, we can launch remote MPI tasks with Globus Compute by wrapping them inside Parsl workflow programs that use Parsl's MPI support.
Flux adds considerable complexity to the software stack to support, and numerous headaches with its installation have slowed development. Therefore Flux should be removed and tests transitioned to Parsl's MPI support as soon as possible.