[question] Training models without VAE

araffin / learning-to-drive-in-5-minutes

Implementation of reinforcement learning approach to make a car learn to drive smoothly in minutes

https://towardsdatascience.com/learning-to-drive-smoothly-in-minutes-450a7cdb35f4

MIT License

284 stars 88 forks source link

[question] Training models without VAE #26

Closed vijpandaturtle closed 4 years ago

vijpandaturtle commented 4 years ago

Hi, does your codebase offer training of the models without VAE ? Thanks

araffin commented 4 years ago

Duplicate of #25

It is possible but not recommended.

Adnan-annan commented 3 years ago

@araffin training without VAE is not recommended, can you specifically mention because of what reasons ? because it will take more time to train ?

araffin commented 3 years ago

because it will take more time to train ?

yes, especially when using SAC, both in term of number of timesteps and wall time. There are different links in the article that explain why decoupling feature extraction from policy learning may be a good thing ;)