huggingface / jat

General multi-task deep RL Agent
Apache License 2.0
164 stars 11 forks source link

Atari surrond is missing from dataset #78

Closed qgallouedec closed 1 year ago

qgallouedec commented 1 year ago

See https://huggingface.co/datasets/gia-project/gia-dataset/discussions/25

edbeeching commented 1 year ago

I trained a policy on this using envpool. But by default sample-factory's push to hub script uses gymnasium. Surround appears to be missing from gymnasium and gym. I raised an issue.

qgallouedec commented 1 year ago

Can you easily switch to v5?

It it supposed to be equivalent to gymnasium.make("ALE/Amidar-v5", frameskip=1, repeat_action_probability=0.0)

EDIT: add repeat_action_probability=0.0

edbeeching commented 1 year ago

Fixed by using envpool: https://huggingface.co/datasets/gia-project/gia-dataset/tree/main/data/atari/surround Closing.