search

Farama-Foundation / D4RL

A collection of reference environments for offline reinforcement learning
Apache License 2.0
1.35k stars 285 forks source link

What does " Timeouts in this dataset are not always marked in medium replay dataset" mean? #162

Closed ChenDRAG closed 2 years ago

ChenDRAG commented 2 years ago

I found this description in the repo wiki. I also found in the medium-replay dataset usually the trajectory is marked as timeout at somewhere like 40 timesteps in a trajectory, which is impossible in an official environment. Why this happens? and how to correct it, please.