search

nikhilbarhate99 / Deterministic-GAIL-PyTorch

PyTorch implementation of Deterministic Generative Adversarial Imitation Learning (GAIL) for Off Policy learning
MIT License
66 stars 16 forks source link

Can you show some papers, or theoretic materials for this algorithm? #3

Open alanyuwenche opened 4 years ago

alanyuwenche commented 4 years ago

Thanks for your sharing.

This "Deterministic" method, which policy only selects actions for states sampled from expert data, is quite interesting. Can you show some papers, or theoretic materials for this algorithm?

alanyuwenche commented 4 years ago

I suppose this "Deterministic" method is similar to "Behavior Cloning" in imitation learning. Therefore, it suffers from the well known limitation including sample- inefficiency, training instability, and dataset bias, which you recognized as high variance in results.

However, you use GAN-based method to learn the policy. Its performance should be better than traditional supervised learning. Finally, it is correct to set random_seed = 0, which means more variety in training.