search

alex-petrenko / sample-factory

High throughput synchronous and asynchronous reinforcement learning
https://samplefactory.dev
MIT License
773 stars 106 forks source link

Fix vtrace #286

Closed alex404 closed 8 months ago

alex404 commented 9 months ago

Sorry for taking ages to get to this... got distracted by ICLR.

Anyway, I ran make format, and more closely followed the instructions in your docs.

If I need to make any further changes just let me know, and I'll get to it faster this time around.

alex404 commented 9 months ago

There was probably a more intelligent way to fix my previous pull request, but I created a new branch and that seemed to have prevented me from doing that.