ray-project / ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
33.89k stars 5.76k forks source link

[rllib] d4rl: offline data path error #16720

Closed juliusfrost closed 3 years ago

juliusfrost commented 3 years ago

What is the problem?

I get the following error when reproducing cql.

gym.error.Error: Attempted to look up malformed environment ID: b'7/site-packages/ray/rllib/d4rl'. (Currently all IDs must be of the form ^(?:[\w:-]+\/)?([\w:.-]+)-v(\d+)$.)

Ray version and other system information (Python version, TensorFlow version, OS): ray 1.4.0, python 3.7, tensorflow 2.5.0, linux

Reproduction (REQUIRED)

Please provide a short code snippet (less than 50 lines if possible) that can be copy-pasted to reproduce the issue. The snippet should have no external library dependencies (i.e., use fake or mock data / environments):

Install rllib with python virtualenv and run the following:

rllib train -f rllib/tuned_examples/cql/halfcheetah-cql.yaml

If the code snippet cannot be run by itself, the issue will be closed with "needs-repro-script".

mvindiola1 commented 3 years ago

I think you forgot the file switch (-f) . Try

rllib train -f rllib/tuned_examples/cql/halfcheetah-cql.yaml

juliusfrost commented 3 years ago

I think you forgot the file switch (-f) . Try

rllib train -f rllib/tuned_examples/cql/halfcheetah-cql.yaml

That was just my typo creating the issue, thanks for the catch.