Open kvablack opened 2 hours ago
Update: I'm guessing a thruster is also broken in thruster_goal
, since this environment should be fairly trivial to solve, but it hasn't been yet:
https://github.com/user-attachments/assets/e8f70b2f-ac86-4897-b5b2-b1e9e60db93b
Hi,
Big fan of this project! I'm trying to train an RL agent on a bunch of large environments at once, and I'm seeing an issue where some linkages are static/immobile when they shouldn't be. Here are HalfCheetah and Pinball:
https://github.com/user-attachments/assets/b804f16b-669d-44c5-ad41-8e1a77e3898d
https://github.com/user-attachments/assets/97c40b7f-fbde-4b17-a4d9-9b2a5140e1fd
The problem exists on hard_pinball, cartpole, mjc_walker, Unicycle, mjc_swimmer, mjc_half_cheetah, mjc_hopper, and grasp_easy. If I download the JSON files and load them into Kinetix.js, they work normally.
Here's my config file to reproduce, used with
experiments/ppo.py
: