[Question] How to set learning rate and scheduler for custom feature extractor?

DLR-RM / stable-baselines3

PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.

https://stable-baselines3.readthedocs.io

MIT License

8.35k stars 1.6k forks source link

[Question] How to set learning rate and scheduler for custom feature extractor? #1941

Closed edwardjjj closed 1 week ago

edwardjjj commented 1 month ago

❓ Question

Hi, everyone I would like to set a learning rate and scheduler for the feature extractor that differs from those of the actor-critic networks. Is there a way to do this?

Checklist

[X] I have checked that there is no similar issue in the repo
[X] I have read the documentation
[X] If code there is, it is minimal and working
[X] If code there is, it is formatted using the markdown code blocks for both code and stack traces.

qgallouedec commented 1 month ago

Hello, this is not a supported feature at the moment. You will probably need to modify the sb3 source code to do what you describe. Feel free to link to your branch or anything else that might be useful if you manage to get it working.