ray-project / ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
33.99k stars 5.78k forks source link

[<Ray component: Core|RLlib|etc...>] Ray component dashboard_agent_http is trying to use a port number 52365 that is used by other components. #37229

Open steadynotion opened 1 year ago

steadynotion commented 1 year ago

What happened + What you expected to happen

Similar to 'port address conflict causing head node enters into an broken state and not usable #14098'

I received the following error when attempting to configure :func:~init:

ValueError: Ray component dashboard_agent_http is trying to use a port number 52365 that is used by other components.
Port information: {'gcs': 'random', 'object_manager': 'random', 'node_manager': 'random', 'gcs_server': 51361, 'client_server': 'random', 'dashboard': 'random', 'dashboard_agent_grpc': 52365, 'dashboard_agent_http': 52365, 'metrics_export': 63567, 'redis_shards': 'random', 'worker_ports': 'random'}
If you allocate ports, please make sure the same port is not used by multiple components.

I have reviewed the Ray docs on configuring ports and there do not appear to be any Python-configurable options to set port numbers manually. Mention is made of command-line switches vice Python API in the docs:

https://docs.ray.io/en/latest/ray-core/configure.html#head-node

As this problem has been identified previously is there any update we can get from the Dev Team on when it will be resolved satisfactorialy?

Thanks for your help on this!

Versions / Dependencies

Version: 2.4.0

Reproduction script

import ray

Calling :func:~init may trigger ValueError on occasion.

ray.init()

Issue Severity

High: It blocks me from completing my task.

jjyao commented 1 year ago

Can you paste your ray.init() code so that I can know how you config the ports?

kaya commented 11 months ago

This issue can occur with a simple ray.init() that takes no arguments.

rbavery commented 4 months ago

I'm also having this issue

solved with https://docs.ray.io/en/latest/cluster/configure-manage-dashboard.html#disabling-the-dashboard