fix(dajianer): add 'collect_kwargs' to the keep function of OnlineRLContext

opendilab / DI-engine

OpenDILab Decision AI Engine

https://di-engine-docs.readthedocs.io

Apache License 2.0

2.79k stars 348 forks source link

fix(dajianer): add 'collect_kwargs' to the keep function of OnlineRLContext #785

Closed dajianer closed 2 months ago

dajianer commented 3 months ago

Description

KeyError: 'eps' occurs when running mixed action space environments. This error is resolved by adding 'collect_kwargs' to the keep function of OnlineRLContext.

Check List

[ ] merge the latest version source branch/repo, and resolve all the conflicts
[ ] pass style check
[ ] pass all the tests

PaParaZz1 commented 3 months ago

Can you describe more details about this error? Current eps in collect_kwargs is only used in a iteration, it will set a new eps value in the new iteration.