Closed belerico closed 1 year ago
This PR introduces the following:
RestartOnexception
step
reset
Please select the one relevant option below:
Please confirm that the following tasks have been completed:
The above rewards are obtained with the following command:
lightning run model --precision=32 --devices=1 --main_port=29401 sheeprl.py dreamer_v3 --total_steps=100000 --learning_starts=1024 --pretrain_steps=1 --train_every=1 --buffer_size=1000000 --memmap_buffer=True --max_episode_steps=108000 --per_rank_batch_size=16 --checkpoint_every=2000 --env_id=MsPacmanNoFrameskip-v4 --seed=5 --cnn_channels_multiplier=32 --dense_units=512 --hidden_size=512 --mlp_layers=2 --recurrent_state_size=512 --checkpoint_buffer=True --action_repeat=4 --cnn_keys rgb --num_envs=1 --capture_video=True --per_rank_sequence_length=64
Thank you for your contribution! Once you have filled out this template, please ensure that you have assigned the appropriate reviewers and that all tests have passed.
Summary
This PR introduces the following:
RestartOnexception
wrapper, which recreates the environment and restarts it if something bad happened during thestep
orreset
Type of Change
Please select the one relevant option below:
Checklist
Please confirm that the following tasks have been completed:
Screenshots or Visuals (Optional)
The above rewards are obtained with the following command:
Thank you for your contribution! Once you have filled out this template, please ensure that you have assigned the appropriate reviewers and that all tests have passed.