Make pickle file of dependency an input

E3SM-Project / polaris

Testing and analysis for OMEGA, MPAS-Ocean, MALI and MPAS-Seaice

BSD 3-Clause "New" or "Revised" License

6 stars 13 forks source link

Make pickle file of dependency an input #80

Closed altheaden closed 1 year ago

altheaden commented 1 year ago

Make pickle file of a dependency an input of the dependent step. In order for a bash app to be a dependency of another bash app, we need to use a data future, so we use the output pickle file as an input.

Checklist

[x] Testing comment in the PR documents testing used to verify the changes

altheaden commented 1 year ago

I did testing with the cosine bell suite (including the viz step) against a baseline, and everything ran successfully.

xylar commented 1 year ago

@altheaden, thanks for making this PR. The cosine bell test ran successfully for me as well. The real test will come once we have task parallelism with bash apps and data futures but this seems to be working as we want in task serial.