IU-CACR / SWIP

Scientific Workflow Integrity with Pegasus (SWIP) issue tracking (no source code).
1 stars 0 forks source link

Review SWIP use cases and identify features needed for each #14

Open von opened 6 years ago

von commented 6 years ago

So we know when to engage the communities.

von commented 6 years ago

FreeSurfer Handle files of 200-300 MB

SPLInter 5 million tasks, with 8 input files each, O(1MB) total, and 2 output files, O(5k) total

1000 Genome poject Fetching data from public dataset

SCEC 150 TB of intermediate data, 8 TB staged out, >1 million node hours (>5 weeks wall clock) Due hashes in parallel