opendilab / DI-engine

OpenDILab Decision AI Engine. The Most Comprehensive Reinforcement Learning Framework B.P.
https://di-engine-docs.readthedocs.io
Apache License 2.0
2.82k stars 352 forks source link

fix(pu): fix hppo entropy_weight to avoid nan error in log_prob #761

Closed puyuan1996 closed 6 months ago

puyuan1996 commented 6 months ago

Description

Related Issue

TODO

Check List

codecov[bot] commented 6 months ago

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (4d53074) 77.11% compared to head (2cae4d8) 77.10%. Report is 3 commits behind head on main.

Files Patch % Lines
ding/policy/ppo.py 0.00% 1 Missing :warning:
ding/rl_utils/td.py 75.00% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #761 +/- ## ========================================== - Coverage 77.11% 77.10% -0.01% ========================================== Files 671 671 Lines 53676 53776 +100 ========================================== + Hits 41394 41466 +72 - Misses 12282 12310 +28 ``` | [Flag](https://app.codecov.io/gh/opendilab/DI-engine/pull/761/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=opendilab) | Coverage Δ | | |---|---|---| | [unittests](https://app.codecov.io/gh/opendilab/DI-engine/pull/761/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=opendilab) | `77.10% <60.00%> (-0.01%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=opendilab#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.