search

facebookresearch / BenchMARL

A collection of MARL benchmarks based on TorchRL
https://benchmarl.readthedocs.io/
MIT License
216 stars 27 forks source link

[Feature] More callbacks #35

Closed matteobettini closed 9 months ago

matteobettini commented 9 months ago

Introduced a training callback (that can be used for example to compute custom losses) and a callback for rendering during evaluation

codecov-commenter commented 9 months ago

Codecov Report

Attention: 10 lines in your changes are missing coverage. Please review.

Comparison is base (ea835d0) 89.17% compared to head (21cd5fd) 83.29%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #35 +/- ## ========================================== - Coverage 89.17% 83.29% -5.88% ========================================== Files 53 53 Lines 2420 2437 +17 ========================================== - Hits 2158 2030 -128 - Misses 262 407 +145 ``` | [Files](https://app.codecov.io/gh/facebookresearch/BenchMARL/pull/35?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch) | Coverage Δ | | |---|---|---| | [benchmarl/experiment/logger.py](https://app.codecov.io/gh/facebookresearch/BenchMARL/pull/35?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-YmVuY2htYXJsL2V4cGVyaW1lbnQvbG9nZ2VyLnB5) | `89.05% <ø> (-2.92%)` | :arrow_down: | | [benchmarl/experiment/experiment.py](https://app.codecov.io/gh/facebookresearch/BenchMARL/pull/35?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-YmVuY2htYXJsL2V4cGVyaW1lbnQvZXhwZXJpbWVudC5weQ==) | `89.44% <83.33%> (-2.49%)` | :arrow_down: | | [benchmarl/environments/common.py](https://app.codecov.io/gh/facebookresearch/BenchMARL/pull/35?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-YmVuY2htYXJsL2Vudmlyb25tZW50cy9jb21tb24ucHk=) | `66.66% <66.66%> (ø)` | | | [benchmarl/experiment/callback.py](https://app.codecov.io/gh/facebookresearch/BenchMARL/pull/35?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-YmVuY2htYXJsL2V4cGVyaW1lbnQvY2FsbGJhY2sucHk=) | `62.16% <50.00%> (-7.07%)` | :arrow_down: | ... and [13 files with indirect coverage changes](https://app.codecov.io/gh/facebookresearch/BenchMARL/pull/35/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.