PPO/SAC decoupled wrong devices passed to the trainers Fabric object upon initialization
GAE now supposes that the dones[t] is the done received transitioning to the t+1 transition
Type of Change
Please select the one relevant option below:
Bug fix (non-breaking change that solves an issue)
Checklist
Please confirm that the following tasks have been completed:
[x] I have tested my changes locally and they work as expected. (Please describe the tests you performed.)
[x] I have added unit tests for my changes, or updated existing tests if necessary.
[x] I have updated the documentation, if applicable.
[x] I have installed pre-commit and run locally for my code changes.
Thank you for your contribution! Once you have filled out this template, please ensure that you have assigned the appropriate reviewers and that all tests have passed.
Summary
This PR bumps the new version of sheeprl, fixing:
dones[t]is the done received transitioning to thet+1transitionType of Change
Please select the one relevant option below:
Checklist
Please confirm that the following tasks have been completed:
Thank you for your contribution! Once you have filled out this template, please ensure that you have assigned the appropriate reviewers and that all tests have passed.