DLR-RM / rl-baselines3-zoo

A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.
https://rl-baselines3-zoo.readthedocs.io
MIT License
2.11k stars 516 forks source link

[Question] trying to run panda environments with RL zoo #392

Closed kiankyars closed 12 months ago

kiankyars commented 1 year ago

❓ Question

Hello, I am trying to train an agent in one of the panda gym environments, but I have been unsuccessfull, recieving the following error:

`File "C:\Users\spsuser\AppData\Local\Programs\Python\Python311\Lib\site-packages\rl_zoo3\exp_manager.py", line 520, in entry_point return str(gym26.envs.registry[env_id].entry_point) # pytype: disable=module-attr


KeyError: 'PandaPush-v1'` after trying to run the following code: 

`py train.py --algo tqc --env PandaPush-v1 `

I am aware that in the panda documentation, it states: "Before training with RL Baselines3 Zoo, you will have to set your own hyperparameters by editing hyperparameters/<ALGO>.yml," but the hyperparameters are in fact in the config file for panda gym v1. Is the error because I need to be using panda gym v3 and must set hyperparameters for those environments, or must I change the import_envs.py file (even though it already contains 
`try:
    import panda_gym  # pytype: disable=import-error
except ImportError:
    panda_gym = None`
)? These are just two guesses.

Any help is appreciated.

### Checklist

- [X] I have checked that there is no similar [issue](https://github.com/DLR-RM/rl-baselines3-zoo/issues) in the repo
- [X] I have read the [SB3 documentation](https://stable-baselines3.readthedocs.io/en/master/)
- [X] I have read the [RL Zoo documentation](https://rl-baselines3-zoo.readthedocs.io)
- [X] If code there is, it is [minimal and working](https://github.com/DLR-RM/stable-baselines3/issues/982#issuecomment-1197044014)
- [X] If code there is, it is formatted using the [markdown code blocks](https://help.github.com/en/articles/creating-and-highlighting-code-blocks) for both code and stack traces.
qgallouedec commented 1 year ago

Next time, please don't ignore the

"Important Note: If your question is anything like "Why is my code generating this error?", you must submit a bug report instead."

As it stands, it's hard to say why. Can you provide me with the system information? (see the bug issue template). Also include the panda-gym version.

qgallouedec commented 12 months ago

Closing because the minimum requirements for requesting assistance are not fulfilled