search

HumanCompatibleAI / evaluating-rewards

Library to compare and evaluate reward functions
https://arxiv.org/abs/2006.13900
Apache License 2.0
61 stars 7 forks source link

Improve PointMass experiment pipeline #49

Closed AdamGleave closed 3 years ago

codecov[bot] commented 3 years ago

Codecov Report

Merging #49 (71917d2) into master (ff76aab) will decrease coverage by 0.14%. The diff coverage is 87.32%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #49      +/-   ##
==========================================
- Coverage   83.59%   83.44%   -0.15%     
==========================================
  Files          68       68              
  Lines        4583     4598      +15     
==========================================
+ Hits         3831     3837       +6     
- Misses        752      761       +9
Impacted Files Coverage Δ
src/evaluating_rewards/serialize.py 72.46% <0.00%> (-1.07%) :arrow_down:
tests/test_scripts.py 100.00% <ø> (ø)
src/evaluating_rewards/scripts/distances/common.py 89.92% <75.00%> (-1.93%) :arrow_down:
src/evaluating_rewards/scripts/distances/epic.py 64.44% <75.00%> (-2.23%) :arrow_down:
src/evaluating_rewards/scripts/distances/npec.py 79.52% <83.33%> (-1.54%) :arrow_down:
...aluating_rewards/scripts/pipeline/train_experts.py 82.60% <88.23%> (-0.27%) :arrow_down:
src/evaluating_rewards/distances/common_config.py 96.29% <100.00%> (+1.55%) :arrow_up:
src/evaluating_rewards/scripts/distances/erc.py 89.36% <100.00%> (-0.23%) :arrow_down:
...ating_rewards/scripts/rewards/train_preferences.py 97.82% <100.00%> (-0.05%) :arrow_down:
...valuating_rewards/scripts/rewards/train_regress.py 95.23% <100.00%> (+0.11%) :arrow_up:
... and 1 more

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update ff76aab...71917d2. Read the comment docs.