search

dask / dask-blog

Dask development blog
https://blog.dask.org/
30 stars 35 forks source link

Add link to "High level performance of Pandas, Dask, Spark, and Arrow" #135

Closed scharlottej13 closed 2 years ago

scharlottej13 commented 2 years ago

@jacobtomlinson @mrocklin I was wondering if it would be OK to add a link to a recent Steppingblocks interview with Coiled on their switch from Spark to Dask to your blog post. I started it at "Why we switched from Spark to Dask" since that section of the video seems most relevant. Full video here.

This is tangentially related to https://github.com/dask/community/issues/259.

cc @adireske

scharlottej13 commented 2 years ago

Thanks @jacobtomlinson for taking the time to clearly explain this. I also read through your comment on https://github.com/dask/community/issues/259 which adds some nice context.

I updated the PR to link instead to a clip of the Steppingblocks interview on the Dask youtube channel on the Dask Use Cases playlist. I think this adds the extra hop you mentioned, but looking forward to hearing your thoughts. We can also edit an even shorter clip, as you mentioned above.

scharlottej13 commented 2 years ago

Apologies for the delay in coming back here. That's exactly the kind of hop I had intended. thanks for humouring me here.

No problem! I think the extra hop makes a lot of sense