FetchReach-v1 changes target position from step 200 to step 220? Why?

openai / mujoco-py

MuJoCo is a physics engine for detailed, efficient rigid body simulations with contacts. mujoco-py allows using MuJoCo from Python 3.

Other

2.87k stars 814 forks source link

Open RyanRizzo96 opened 5 years ago

RyanRizzo96 commented 5 years ago

Describe the bug FetchReach-v1 seems to be changes target position from step 200 to step 220. I present two images below.

Shouldn't the goal be the same throughout the episode?

To Reproduce Runpython3 -m baselines.run --alg=her --env=FetchReach-v1 --num_timesteps=10000 --save_path=.models/FetchReach_10k_her --play

Expected behavior I would expect the goal/target to be the same from step 200 all the way to step 1200.

RyanRizzo96 commented 5 years ago

Any suggestions anyone?