chandar-lab / RLHive

MIT License
100 stars 9 forks source link

Buffer for on-policy algorithms like PPO, TRPO #271

Open sriyash421 opened 2 years ago

sriyash421 commented 2 years ago

Implementation of on policy algorithms would need an online buffer that holds the transitions, calculates the generalized advantage returns and then samples batches during training.

Or, should we leave this part on the agent side and have the agent calculate the returns.

This is needed because the current simple buffer samples random batches so we need additional features for on-policy learning.

dapatil211 commented 2 years ago

@kshitijkg is currently working on a basic version of a buffer for this.