Establish benchmark workflows

Parsl / parsl

Parsl - a Python parallel scripting library

http://parsl-project.org

Apache License 2.0

506 stars 195 forks source link

Establish benchmark workflows #131

Open annawoodard opened 6 years ago

annawoodard commented 6 years ago

We should establish benchmark workflows that we can use to stress test Parsl in order to compare different Parsl versions. Preferably these would be run before each release, so that the impact of new features on performance can be documented and understood.

djf604 commented 6 years ago

I can definitely help provide you a bioinformatics workflow, if you're interested.

annawoodard commented 6 years ago

Thanks @djf604! I will definitely take you up on that! Just ping me on Slack and let me know when a good time for you to meet for a quick chat would be.

benclifford commented 1 year ago

related to this, PR #2641 introduces a CLI parsl-perf which runs a large number of tasks in a benchmark-like workflow.