ACDguide / BigData

Working with big/challenging data collections
https://ACDguide.github.io/BigData
Other
6 stars 5 forks source link

Dask tips #71

Open dougiesquire opened 2 years ago

dougiesquire commented 2 years ago

I wonder if the use of dask is sufficiently complex that it warrants its own section? Using this issue to document lesser-known tools/hacks that could potentially be included:

paolap commented 2 years ago

As dask, chunking etc are partially covered in the computations notebook, I wonder if the best approach would be to use that notebook as an introduction and then add sub-sections that go more deeply into:

paolap commented 2 years ago

Just ignore my comment I see that this is also covered in #69