accepted change from santosh on github

dask / dask-yarn

Deploy dask on YARN clusters

http://yarn.dask.org

BSD 3-Clause "New" or "Revised" License

69 stars 41 forks source link

accepted change from santosh on github #162

Open cjac opened 2 months ago

cjac commented 2 months ago

@vdechand - can you help us with this one? I see in https://github.com/jcrist/skein/issues/165 that you have some experience with dask-yarn

I must use dask-yarn<2022.2 in order for my tests to pass

https://github.com/GoogleCloudDataproc/initialization-actions/blob/master/dask/verify_dask_yarn.py

vdechand commented 2 months ago

Hi, I wish I could help you with that, sorry. The reality is that I haven't used dask since 2019.

jacobtomlinson commented 2 months ago

Happy to try and help out here. Let me know what you are trying to do and I'll see if I can help.

cjac commented 2 days ago

Hello Jacob,

dask-yarn seems to be pretty out of date and depends on an implementation that's contrary to the latest libraries. Can you help to get the yarn integration back up to snuff?