-
Some possibilities:
* Job arrays: https://slurm.schedmd.com/job_array.html (pointed out by @jeromekelleher)
* funcX: https://funcx.org/
* Parsl: https://parsl-project.org/
cc @TomNicholas
-
### What would you like to happen?
During analysis of DoFn types, when there's an issue with a type such as having an unencodable Exported field type, it can end up causing a message `bad return type…
-
**Is your feature request related to a problem? Please describe.**
This is more of a technical problem that bothers us as developers than users, but having a well-defined task life-cycle would help…
-
funcx endpoint should check funcx version match, instead of parsl version, between interchange and manager
-
Currently, all input is specified through `run_flow`, including funcx endpoints, globus endpoints, paths, and even overridden funcx ids. This makes clients a bit inflexible when maintained by multiple…
-
# Overview
Parsl has a facility called Channels intended to support use cases such as running a workflow on your laptop but with task execution on a supercomputer. This facility never evolved beyon…
-
This is an assignment for me (@matthewfeickert) and this Issue serves as a reminder for me and also a way to interact with the funcX dev team on this while I write up things and before I make a PR.
…
-
Add an example to show running multiple funcx tasks at the same time
-
Following the readme at: https://github.com/funcx-faas/funcX/tree/forwarder_rearch_1/funcx_sdk/funcx/tests
Only change to the readme code was editing the config.py for the "test_local" endpoint I c…
-
Launch funcx-endpoint following instructions here:
https://github.com/funcx-faas/funcX/tree/forwarder_rearch_1/funcx_sdk/funcx/tests
Part of the test campaign: #318