search

luchris429 / purejaxrl

Really Fast End-to-End Jax RL Implementations
Apache License 2.0
736 stars 63 forks source link

Trying to run `continuous_mountain_car.py` with `ppo_continuous_action` #26

Closed marcdelabarrera closed 5 months ago

marcdelabarrera commented 5 months ago

As the title says, I'm trying to solve the gymnax environment continuous_mountain_car.py. But when using the BraxGymnaxWrapper, I get a KeyError: 'MountainCarContinuous-v0' because this is not a brax environment. Am I missing something?

I'd like to create my own environment and solve it with purejaxrl but I´d like to see ppo_continuous_action in action before.

luchris429 commented 5 months ago

Yeah, MountainCarContinuous-v0 is not a brax environment. You can see the list of them here!.

You should get rid of the BraxGymnaxWrapper and just use the Gymnax env directly! The BraxGymnaxWrapper turns a Brax env into a gymnax interface.

luchris429 commented 5 months ago

Let me know if you have any more problems!