search

danijar / dreamerv2

Mastering Atari with Discrete World Models
https://danijar.com/dreamerv2
MIT License
898 stars 195 forks source link

Skipped short episode of length 10. #19

Closed robjlyons closed 3 years ago

robjlyons commented 3 years ago

May I ask what this means?

Is there something wrong with my env?

Thanks,

danijar commented 3 years ago

The agent trains on sequences of length 50. If the agent collects an episode that ends earlier, it will be skipped during data loading. It's nothing to worry about, unless the majority of your episode are shorter than 50.