openai / baselines

OpenAI Baselines: high-quality implementations of reinforcement learning algorithms
MIT License
15.83k stars 4.88k forks source link

[Question] Compatibilities wrappers for Atari games and gymnasium #1217

Closed TheGravityZero closed 1 year ago

TheGravityZero commented 1 year ago

Question

Where can I get these wrappers that are compatible with gymnasium?

from stable_baselines3.common.atari_wrappers import (
    ClipRewardEnv,
    EpisodicLifeEnv,
    FireResetEnv,
    MaxAndSkipEnv,
    NoopResetEnv,
)

If you use them from sb3, then there is a problem:

obs, reward, done,  info = self.env.step(action)
ValueError: too many values to unpack (expected 4)