search

dask / knit

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead
http://knit.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
53 stars 10 forks source link

container cannot start dask workers #69

Closed zwang1986 closed 6 years ago

zwang1986 commented 7 years ago

This post refers to my last issue. task submitted never be executed using dask-yarn New findings:

  1. Yarn save application logs after killing my dask application;
  2. From Yarn log, it can be found that wokers are not started in container.
jcrist commented 6 years ago

dask-yarn has been rewritten, and should be more robust to different hadoop configurations. Please see the docs (https://dask-yarn.readthedocs.io/en/latest/) and new repo (https://github.com/dask/dask-yarn). Closing.