Open FANLONGFANLONG opened 3 years ago
I put 500 GB for a worker accidentally to start yarn cluster. But looks likely
I can create cluster(application) on yarn because i got cluster.app_id and cluster.scheduler_address.
i use client.wait_for_workers to wait for worker ready
but dask got stuck.
i checked application on yarn and it is failed already
the issue is reproduced.
May I know what I could do to avoid the problem?
This sounds like a yarn specific problem and I suggest to repost this on the issue tracker of https://github.com/dask/dask-yarn
Just transferred this issue over to the dask-yarn repo
dask-yarn
@jrbourbeau thanks
I put 500 GB for a worker accidentally to start yarn cluster. But looks likely
I can create cluster(application) on yarn because i got cluster.app_id and cluster.scheduler_address.
i use client.wait_for_workers to wait for worker ready
but dask got stuck.![image](https://user-images.githubusercontent.com/22552116/114248072-a123b180-994b-11eb-8070-1ef1da84ed76.png)
i checked application on yarn and it is failed already![image](https://user-images.githubusercontent.com/22552116/114248183-d7f9c780-994b-11eb-907e-78ba878f3177.png)
the issue is reproduced.
May I know what I could do to avoid the problem?