Farama-Foundation / Metaworld

Collections of robotics environments geared towards benchmarking multi-task and meta reinforcement learning
https://metaworld.farama.org/
MIT License
1.28k stars 274 forks source link

Temporary fix for CI failing on `all_close` call checking repeated environment resets #444

Closed reginald-mclean closed 1 year ago

reginald-mclean commented 1 year ago

This change to CI changes the looseness of the "all_close" call when ensuring that observations are the same across environment resets. This is a logged issue (Issue #443) and will be dealt with accordingly. It's most likely due to changes in Mujoco bindings.

pseudo-rnd-thoughts commented 1 year ago

To confirm this is a permanent fix?

reginald-mclean commented 1 year ago

@pseudo-rnd-thoughts This is a temporary fix. We need to spend some time reviewing the tests, I just don't have the bandwidth right now. This temporary change should allow for CI to pass consistently until we revamp the tests