Replay buffer broken in `train_hypergrid.py`

GFNOrg / torchgfn

GFlowNet library

https://torchgfn.readthedocs.io/en/latest/

Other

209 stars 26 forks source link

Replay buffer broken in `train_hypergrid.py` #168

Closed josephdviviano closed 5 months ago

josephdviviano commented 6 months ago

When a replay buffer is being used, the gflownet will not converge, but will if there is no replay buffer. I suspect this has something to do with off-policy logic changes that were introduced here:

https://github.com/GFNOrg/torchgfn/pull/147