dask / dask-blog

Dask development blog
https://blog.dask.org/
30 stars 35 forks source link

Cross post p2p shuffling #169

Closed scharlottej13 closed 1 year ago

scharlottej13 commented 1 year ago

@hendrikmakait wrote this for the Coiled blog, but the content is Dask-focused so I think it would be a good fit for cross-posting on blog.dask.org (see https://github.com/dask/community/issues/291#issuecomment-1317749720 for some discussion around this, noting we did something similar in https://github.com/dask/dask-blog/pull/151).

I made no content changes from the original post.

cc @jacobtomlinson

netlify[bot] commented 1 year ago

Deploy Preview for dask-blog ready!

Name Link
Latest commit 2954e53f74276c6e7e0de8b2a5cd5a139ccd2262
Latest deploy log https://app.netlify.com/sites/dask-blog/deploys/6470dcb560d5910008c0aee2
Deploy Preview https://deploy-preview-169--dask-blog.netlify.app/2023/03/15/shuffling-large-data-at-constant-memory
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

scharlottej13 commented 1 year ago

I've made one small comment about switching out a Coiled cluster for an OSS one, but apart from that this is a very Dask-focused post.

Thanks @jacobtomlinson! I've just included your suggestion.

I wonder if we want to expand the notice at the top, this post was not only shared from the Coiled blog but this work was sponsored and engineered by Coiled. I would see no problems with being more explicit about that.

Ah that's a great idea! I'll add this to the top

having posts that are loud and clear about Coiled's investment in Dask shows how vibrant and alive OSS Dask is.

well said :)

cc @ emilyvalentine

scharlottej13 commented 1 year ago

Thanks for the help @jacobtomlinson! I think this is good to merge.

jacobtomlinson commented 1 year ago

Thanks all!