DLR-RM / rl-baselines3-zoo

A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.
https://rl-baselines3-zoo.readthedocs.io
MIT License
2k stars 510 forks source link

[Question] Training Donkey Car Without Simulator Rendering #417

Open Gribesh opened 11 months ago

Gribesh commented 11 months ago

❓ Question

I've been training a reinforcement learning agent for the Donkey Car environment using Stable Baselines3 Zoo. My training command is as follows:

python train.py --algo tqc --env donkey-waveshare-v0 --eval-freq -1 --save-freq 20000 --tensorboard-log ./tblog

I've noticed that the visual rendering of the simulator significantly slows down the training process. I'd like to speed up the training by disabling this simulator rendering. Upon checking the training code, I didn't find any parameter or flag that controls the rendering.

Is there a way to train it without rendering the env? If so, could you please guide me on how to train the agent without the visual overhead of the simulator? Any insights or document recommendations would be highly appreciated!

Thank you

Checklist

araffin commented 11 months ago

Hello,

Is there a way to train it without rendering the env? If so, could you please guide me on how to train the agent without the visual overhead of the simulator?

This is more a question for the donkey car simulation. I tried in the past but without success, however, you can now play the simulation faster than realtime.

Gribesh commented 11 months ago

Oh okay. Thanks for the information.

Actually, I wanted to run the algorithm for a few million steps in the AWS Sagemaker.