search

Farama-Foundation / Arcade-Learning-Environment

The Arcade Learning Environment (ALE) -- a platform for AI research.
https://ale.farama.org/
GNU General Public License v2.0
2.19k stars 429 forks source link

Object Rendering Issue #578

Open emdeutsch opened 2 weeks ago

emdeutsch commented 2 weeks ago

I am building a RL bot for Frogger and Space Invader and when I use the RecordVideo Wrapper, as well as when I print the observed frames by the AI, all of the objects on the same row as the AI are not visible for Frogger. Similarly, enemy bullets are never visible in Space Invader. Both of these objects happen to be transparent in human mode, has anyone experienced this and is there an easy work around?

emdeutsch commented 2 weeks ago
Screenshot 2024-11-18 at 5 31 53 PM

https://github.com/user-attachments/assets/5d14811d-2fd9-4aef-81a9-81409fcd4309

Here are some examples, and as far as I can tell the AI cannot see these objects either. Again, in human mode, it all looks good.

pseudo-rnd-thoughts commented 2 weeks ago

If you are using frameskip>1 then this will cause issues in some environments as some objects will flicker to optimise GPU resources. You can avoid this through the base environment using frameskip=1, then the RecordVideo wrapper then the AtariPreprocessing wrapper to apply frameskip