-
I've set `use_gpu = True`, but the GPU useage is almost close to zero when running the code. When I look into tensorboard, it shows that all operations are assigned to CPU. Then I disable `sess_confi…
-
Hello, I have found your work and code exetremely helpful! Thank you for your code and work.
However, during my usage, I found several point to be confusing and not sure if I am doing right, so I hop…
-
https://github.com/Mikoto10032/DeepLearning/blob/master/books/%5B%E6%B7%B1%E5%BA%A6%E5%BC%BA%E5%8C%96%E5%AD%A6%E4%B9%A0%5D%5BHung-yi%20Lee%5D/PPO%20(v3).pdf
in this pdf page 9. formula as this
𝑝𝜃…
-
As discussed in [sb3#346](https://github.com/DLR-RM/stable-baselines3/issues/346), I'd like to merge [an existing implementation of the PPG algorithm](https://github.com/janEbert/sb3-ppg).
I'm unsu…
-
## ❓ Questions and Help
I've trained and validated a PPO model using that example in the Readme file and I'm looking forward to deploying this model to the locobot and use PyRobot with.
Also, I fo…
-
Error Info:
File "/data/rooter_use/conda/envs/llama-env39/lib/python3.9/site-packages/deepspeed/runtime/hybrid_engine.py", line 398, in step
actor_loss, critic_loss = trainer.train_rlhf(exp_da…
-
Thanks for your great work! But I find some questions about `actor_optimizer, static_actor_optimizer` in `train_ppo_fbs_static_dynamic.py` line 611. Maybe you forgot to define these two optimizers so…
-
### What happened + What you expected to happen
I have been using RLlib with a multi-agent CARLA environment (adapted from [this](https://github.com/carla-simulator/rllib-integration) integration) wh…
-
1st question: Open flowers Present?
|_ No: To question 2
|_ Yes: Move on
2nd question: Flower buds present? (indicating presence of flowers (PPO))
|_ No: move one
|_…
-
### ❓ Question
I would think 0.99 is the most widely used default value, so I suggest using that for PPO as well.
### Checklist
- [X] I have checked that there is no similar [issue](https://github.…