Describe the purpose of the pull request, including:
Fix the policy step update for on-policy algorithms: the rollout steps must not be included when updating the policy step (the update is inside the rollout for loop)
Type of Change
Please select the one relevant option below:
Bug fix (non-breaking change that solves an issue)
Checklist
Please confirm that the following tasks have been completed:
[x] I have tested my changes locally and they work as expected. (Please describe the tests you performed.)
[x] I have added unit tests for my changes, or updated existing tests if necessary.
[x] I have updated the documentation, if applicable.
[x] I have installed pre-commit and run locally for my code changes.
Summary
Describe the purpose of the pull request, including:
Type of Change
Please select the one relevant option below:
Checklist
Please confirm that the following tasks have been completed: