Closed Howuhh closed 1 year ago
Yes, ~80 fps sounds reasonable. That comes down to MuJoCo engine, see e.g. #openai/mujoco-py/issues/277
The way to speed it up for larger-scale RL training is to run multiple environment workers in separate processes.
Also note: there are different MuJoCo rendering settings so you can try setting MUJOCO_GL=glfw
vs egl
vs osmesa
and see if it makes a difference. EGL is supposed to be the fastest, if supported, and we are defaulting to that.
Hi! Just want to double check. I noticed that rollouts are a lot longer than I expected and created a simple test with random actions:
On my M1 this will take almost 2 minutes just for 10 random rollouts. Is it normal? Because it's very slow (~80fps).