facebookresearch / CompilerGym

Reinforcement learning environments for compiler and program optimization tasks
https://compilergym.ai/
MIT License
879 stars 123 forks source link

Feature request: migrate from gymnasium to gym #789

Open elliottower opened 1 year ago

elliottower commented 1 year ago

🚀 Feature

Hi, would it be possible for it to be upgraded from gym to gymnasium? Gymnasium is the maintained version of openai gym and is compatible with current RL training libraries (rllib and tianshou have already migrated, and stable-baselines3 will soon).

For information about upgrading and compatibility, see migration guide and gym compatibility. The main difference is the API has switched to returning truncated and terminated, rather than done, in order to give more information and mitigate edge case issues.

Additional context

Hi, this repository is currently listed in the gymnasium third party environments but we are cleaning the list up to only include maintained gymnasium-compatible repositories.

ChrisCummins commented 1 year ago

Hi @elliottower, thanks for reaching out.

would it be possible for it to be upgraded from gym to gymnasium?

Yes, it's on our roadmap, but we haven't yet found resources to work on it. It'll be quite a chunk of work to port the existing code to the new interface and ensure no regressions. Thanks for confirming the migration of training libraries to gymnasium, that was a blocker at the time we first discussed this.

Cheers, Chris