isaac-sim / OmniIsaacGymEnvs

Reinforcement Learning Environments for Omniverse Isaac Gym
Other
816 stars 209 forks source link

Feature Request: migrate from gym to gymnasium #28

Open elliottower opened 1 year ago

elliottower commented 1 year ago

Hi, would it be possible for IsaacGymEnvs to be upgraded from gym to gymnasium? Gymnasium is the maintained version of openai gym and is compatible with current RL training libraries (rllib and tianshou have already migrated, and stable-baselines3 will soon).

This repository is currently listed in the gymnasium third party environments but we are cleaning the list up to only include maintained gymnasium-compatible repositories.

For information about upgrading and compatibility, see migration guide and gym compatibility. The main difference is the API has switched to returning truncated and terminated, rather than done, in order to give more information and mitigate edge case issues.

kellyguo11 commented 1 year ago

Hi, yes, this is on our roadmap. We will be looking into this for our future releases.

elliottower commented 1 year ago

Hi, yes, this is on our roadmap. We will be looking into this for our future releases.

Good to hear, thanks! Once the switch is made could you post here? Makes it simpler to update the third party repos document.

We are also gathering examples of training with different third party libraries, if there is interest in that we’d love to include some using the isaac envs.