search

Miffyli / ToriLLE

Toribash Learning Environment
GNU General Public License v3.0
49 stars 7 forks source link

Are there any plans to convert this to gymnasium (from gym)? #6

Open contravarianceisuseful opened 7 months ago

contravarianceisuseful commented 7 months ago

My understanding is that most RL algorithms will focus on supporting gymnasium going forward and that will be the standard. Trying to get ray rllib or other RL libraries with gym environments is pretty tricky these days. ray kept changing their libraries, so I've ended up having to make a bunch of different venvs for each of the specific versions.

I feel like this would all be a lot easier and sustainable if it was converted to gym. If anyone else thinks this might be useful, I might have a go at doing it myself.

Miffyli commented 7 months ago

Hey, sorry for the delay! I have been off the grid.

There are no plans to update this library, but happy to review and merge changes if someone comes up with updated environments for gymnasium or other APIs (as long as they are simple enough to review)! I am also happy to link to your projects or forks if somebody wants to fork this project and continue developing it with no strings attached :)

contravarianceisuseful commented 7 months ago

I looked into this. In theory you can use this but I never managed to get it to work. I've abandoned the project for now due to not being able to get the underlying infrastructure to work, but that was more about the RL algorithm than toribash itself.