DLR-RM / rl-baselines3-zoo

A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.
https://rl-baselines3-zoo.readthedocs.io
MIT License
1.89k stars 494 forks source link

[Question] How many startup trials in distributed optimization #450

Closed mzelazko closed 1 month ago

mzelazko commented 1 month ago

❓ Question

I'm distributing optimization across 6 processes. I know if I use for each of 6 processes --n-trials 100 then i will get 600 trials. But what with --n-startup-trials 10? Will there be 10 or 60 startup trials?

Checklist

araffin commented 1 month ago

hen i will get 600 trials.

correct.

Will there be 10 or 60 startup trials?

I'm not sure about that one, but I would assume 10 if you use a database. I also would say it's more an optuna question than a RL Zoo one.

mzelazko commented 1 month ago

I have used database indeed. I added print function next to random sampler and it appeard that the answer is 10 startup trials for 6 processes on --n-startup-trials 10 . Thank you for answer.