Closed josephdviviano closed 5 months ago
When a replay buffer is being used, the gflownet will not converge, but will if there is no replay buffer. I suspect this has something to do with off-policy logic changes that were introduced here:
https://github.com/GFNOrg/torchgfn/pull/147
When a replay buffer is being used, the gflownet will not converge, but will if there is no replay buffer. I suspect this has something to do with off-policy logic changes that were introduced here:
https://github.com/GFNOrg/torchgfn/pull/147