JuliaReinforcementLearning / ReinforcementLearningTrajectories.jl

A generalized experience replay buffer for reinforcement learning
MIT License
8 stars 7 forks source link

DummySampler samples invalid indices #69

Open HenriDeh opened 4 months ago

HenriDeh commented 4 months ago

See https://github.com/JuliaReinforcementLearning/ReinforcementLearning.jl/issues/1068 .

We can either fix DummySampler, or make a new full trajectory sampler. In the former case, I think it should be renamed because it's not really dummy.

johannes-fischer commented 1 month ago

As I wrote in the linked issue, BatchSampler has the same behavior.