search

Denys88 / rl_games

RL implementations
MIT License
863 stars 146 forks source link

When to use Model or Network? #252

Closed HGGshiwo closed 1 year ago

HGGshiwo commented 1 year ago

I notice that Model and Network both inherit nn.Module, so if I want to custom my network, which one should I use to overwrite, and what are their differences? By the way, is it possible to pre-train the actor network use a pid controller, then train it like normal ways in rl_games?

Looking forward your quick reply, thanks.

Denys88 commented 1 year ago

Hi, @HGGshiwo network represents exact NN: MLP or CNN or RNN or etc. Model has distribution around it. For example it could be continuous or discrete. Plus normalization is applied inside of the model.