search

araffin / rl-baselines-zoo

A collection of 100+ pre-trained RL agents using Stable Baselines, training and hyperparameter optimization included.
https://stable-baselines.readthedocs.io/
MIT License
1.12k stars 208 forks source link

Converting a model into PyTorch #31

Closed p-christ closed 5 years ago

p-christ commented 5 years ago

Hi,

I'm trying to load your pre-trained DQN Breakout agent into a PyTorch network. I have figured out how to get the weights transferred over but the pytorch agent is still not able to do well on the game.

I'm using the exact same env object as in the non-pytorch case which works so that isn't the cause. I think the cause must be that the stable-baselines agent does some pre-processing behind the scenes that I am not aware of. Can anyone help me with some advice on this?

e.g. at the very least I imagine the stable-baseline agent normalises pixel values to the range 0-1 but I can't find anywhere where this is happening?

araffin commented 5 years ago

Hello,

Could you open that issue in stable-baselines repo? As it does not seem directly related to th rl zoo.