Open mortenhoyer opened 1 year ago
I'm seeing same error message on 2.10.0
, not sure where to look for debugging it.
EDIT: I'm using a proxy for internet. In my case this was due to not adding the local IPs of the head/workers to no_proxy
environment variable when starting ray in the terminal, the 403 FORBIDDEN
came from the proxy when ray head node (not client) tried to connect to the RuntimeEnvAgent using the local IP.
Still have this exact same issue at 2.21.0. Changing no_proxy didn’t work for me
seems like there's more folks in the community running into this @rynewang @jjyao did we ever root cause this?
What happened + What you expected to happen
Unable to connect to a ray cluster with via the client in version 2.7.0 when specifying a working_dir. Works in 2.6.3
Versions / Dependencies
ray 2.7.0 python 3.10 or 3.11, same result in both linux 9
Reproduction script
Start head node like this:
ray start --head
Run this python script:
output:
Issue Severity
Medium: It is a significant difficulty but I can work around it.