turn off replay buffer while we determine issue with off policy sampling

GFNOrg / torchgfn

GFlowNet library

https://torchgfn.readthedocs.io/en/latest/

Other

209 stars 26 forks source link

turn off replay buffer while we determine issue with off policy sampling #166

Closed josephdviviano closed 6 months ago

josephdviviano commented 6 months ago

this turns off the replay buffer for train_hypergrid while we figure out which bug is causing the issue with off policyness when using a replay buffer.