Are there any benchmarks for SIL?

kengz / SLM-Lab

Modular Deep Reinforcement Learning framework in PyTorch. Companion library of the book "Foundations of Deep Reinforcement Learning".

https://slm-lab.gitbook.io/slm-lab/

MIT License

1.23k stars 263 forks source link

Are there any benchmarks for SIL? #478

Closed zhihaocheng closed 3 years ago

zhihaocheng commented 3 years ago

Hi @kengz , your SLM-Lab is a great job. I am trying to use SIL (self-imitation learning) for my project. Do you have tested this algorithm in SLM-Lab, especially for PPO? I tried to implement SIL with PPO, but I found it did not work. In other words, SIL does not help to improve PPO.

kengz commented 3 years ago

@zhihaocheng SIL is not part of the main benchmark we ran with Atari. But there are some sanity-check basic benchmark of SIL in SLM Lab:

PPO+SIL: https://github.com/kengz/SLM-Lab/pull/212
A2C+SIL: https://github.com/kengz/SLM-Lab/pull/201

zhihaocheng commented 3 years ago

@kengz many thanks