v2.0 Experiment: Dask Cluster and Processing Improvements (4/4)

askap-vast / vast-pipeline

This repository holds the code of the Radio Transient detection pipeline for the VAST project.

https://vast-survey.org/vast-pipeline/

MIT License

8 stars 3 forks source link

v2.0 Experiment: Dask Cluster and Processing Improvements (4/4) #708

Open ajstewart opened 7 months ago

ajstewart commented 7 months ago

This is part of experimenting with new features for a potential v2.0

See this GIST: https://gist.github.com/ajstewart/9257bd3be3389d37058ab6bae5377904

This is PR 4/4

What is in this PR?

This PR picks up where #337 left off and moves processing to a Dask Cluster that is spun up through the ./manage.py cli. There are more notes on the Gist.