utiasDSL / gym-pybullet-drones

PyBullet Gymnasium environments for single and multi-agent reinforcement learning of quadcopter control
https://utiasDSL.github.io/gym-pybullet-drones/
MIT License
1.22k stars 357 forks source link

Feature Request: migrate from gym to gymnasium #139

Closed elliottower closed 10 months ago

elliottower commented 1 year ago

Hi, would it be possible for pybullet-drones to be upgraded from gym to gymnasium? Gymnasium is the maintained version of openai gym and is compatible with current RL training libraries (rllib and tianshou have already migrated, and stable-baselines3 will soon).

This repository is currently listed in the gymnasium third party environments but we are cleaning the list up to only include maintained gymnasium-compatible repositories.

For information about upgrading and compatibility, see migration guide and gym compatibility.

I see there's been a little discussion in the issues and PRs about migration (https://github.com/utiasDSL/gym-pybullet-drones/pull/136, https://github.com/utiasDSL/gym-pybullet-drones/issues/133), just wanted to check if there were any plans to migrate.

JacopoPan commented 1 year ago

Yes, PR #138 is now the one checking if the interface migration works with the more recent rllib scripts.

elliottower commented 1 year ago

Yes, PR #138 is now the one checking if the interface migration works with the more recent rllib scripts.

Great to hear. RLlib 2.3.0 supports gymnasium (and pettingzoo) so it should work. We would like to create a resource for each training library with links to examples using them, so if the script is adapted successfully could you post here? Would be super useful for new users to see real usage examples.

JacopoPan commented 10 months ago

This is now completed