search

sail-sg / envpool

C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.
https://envpool.readthedocs.io
Apache License 2.0
1.1k stars 100 forks source link

[Feature Request] Get RAM State from Atari ALE #294

Open SumeetBatra opened 8 months ago

SumeetBatra commented 8 months ago

Hi folks,

I'm wondering if there is a way to access the RAM state for Atari environments, or if this can be implemented as a feature if not. The RAM buffer contains additional low-dimensional information such as player position info that is useful for some learning tasks. Gymnasium provides an interface to get the RAM state like so env.ale.getRAM() which returns a 128-length numpy array corresponding to the RAM state. Seems like this would be a pretty straightforward addition? Thanks!

renos commented 8 months ago

+1

alexxchen commented 8 months ago

Just curious. How is the performance on atrai ram? I suffered from very poor performance using ppo compared to RGB state.

renos commented 8 months ago

@alexxchen ALE Ram state is useful for object-centric learning work

alexxchen commented 8 months ago

@alexxchen ALE Ram state is useful for object-centric learning work

@renos Thanks for your information! I hit a blind spot in my knowledge!

renos commented 8 months ago

297