Open vyasakash231 opened 5 months ago
In the rollout() function, at https://github.com/rail-berkeley/rlkit/blob/master/rlkit/samplers/rollout_functions.py A condition is given that if done is True, then terminal will also turn true.
terminal = False if done: # terminal=False if TimeLimit caused termination if not env_info.pop('TimeLimit.truncated', False): terminal = True terminals.append(terminal) dones.append(done) actions.append(a) next_observations.append(next_o) raw_next_obs.append(next_o) agent_infos.append(agent_info) env_infos.append(env_info) path_length += 1 if done: break
Now, in all of the .json files, it was specified that ignore_done=True, which means done is always false.
ignore_done=True
"eval_environment_kwargs": { "control_freq": 20, "controller": "OSC_POSE", "env_name": "Lift", "hard_reset": false, "horizon": 500, "ignore_done": true, "reward_scale": 1.0, "robots": [ "Sawyer" ] }, "expl_environment_kwargs": { "control_freq": 20, "controller": "OSC_POSE", "env_name": "Lift", "hard_reset": false, "horizon": 500, "ignore_done": true, "reward_scale": 1.0, "robots": [ "Sawyer" ]
Can anyone please explain this part?
In the rollout() function, at https://github.com/rail-berkeley/rlkit/blob/master/rlkit/samplers/rollout_functions.py A condition is given that if done is True, then terminal will also turn true.
Now, in all of the .json files, it was specified that
ignore_done=True
, which means done is always false.Can anyone please explain this part?