Closed matteobettini closed 4 weeks ago
When advantage is pre-computed on massive batch sizes with non-trivial models this can require an unreasonable amount of memory
When advantage is pre-computed on massive batch sizes with non-trivial models this can require an unreasonable amount of memory