facebookresearch / BenchMARL

A collection of MARL benchmarks based on TorchRL
https://benchmarl.readthedocs.io/
MIT License
191 stars 23 forks source link

[Feature] Disable pre-compute advantage PPO #97

Closed matteobettini closed 4 weeks ago

matteobettini commented 1 month ago

When advantage is pre-computed on massive batch sizes with non-trivial models this can require an unreasonable amount of memory