-
Some possibilities:
* Job arrays: https://slurm.schedmd.com/job_array.html (pointed out by @jeromekelleher)
* funcX: https://funcx.org/
* Parsl: https://parsl-project.org/
cc @TomNicholas
-
# Overview
Parsl has a facility called Channels intended to support use cases such as running a workflow on your laptop but with task execution on a supercomputer. This facility never evolved beyon…
-
Currently, all input is specified through `run_flow`, including funcx endpoints, globus endpoints, paths, and even overridden funcx ids. This makes clients a bit inflexible when maintained by multiple…
-
funcx endpoint should check funcx version match, instead of parsl version, between interchange and manager
-
**Is your feature request related to a problem? Please describe.**
This is more of a technical problem that bothers us as developers than users, but having a well-defined task life-cycle would help…
-
This is an assignment for me (@matthewfeickert) and this Issue serves as a reminder for me and also a way to interact with the funcX dev team on this while I write up things and before I make a PR.
…
-
### What would you like to happen?
During analysis of DoFn types, when there's an issue with a type such as having an unencodable Exported field type, it can end up causing a message `bad return type…
-
**Describe the bug**
Occasionally triggers a SIGBUS: bus error
**To Reproduce**
```go
package main
import (
"testing"
"github.com/bytedance/mockey"
"github.com/smartystreets/goconve…
-
There is a lot of lag time between automate flows switching states. It would help to have a utility to test a funcx function directly instead of running it through a flow.
Since Gladier has a list…
-
Following the readme at: https://github.com/funcx-faas/funcX/tree/forwarder_rearch_1/funcx_sdk/funcx/tests
Only change to the readme code was editing the config.py for the "test_local" endpoint I c…