Add Integration with RAGAS

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage: 17.35% and project coverage change: -3.17% :warning:

Comparison is base (5b21afd) 47.69% compared to head (ab84146) 44.52%.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #114 +/- ## ========================================== - Coverage 47.69% 44.52% -3.17% ========================================== Files 31 31 Lines 671 703 +32 ========================================== - Hits 320 313 -7 - Misses 351 390 +39 ``` | [Files Changed](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl) | Coverage Δ | | |---|---|---| | [fastrepl/errors.py](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl#diff-ZmFzdHJlcGwvZXJyb3JzLnB5) | `5.88% <ø> (+0.61%)` | :arrow_up: | | [fastrepl/eval/base.py](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl#diff-ZmFzdHJlcGwvZXZhbC9iYXNlLnB5) | `0.00% <0.00%> (ø)` | | | [fastrepl/eval/metric/sas.py](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl#diff-ZmFzdHJlcGwvZXZhbC9tZXRyaWMvc2FzLnB5) | `80.95% <ø> (ø)` | | | [fastrepl/eval/model/llm\_head\_cot.py](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl#diff-ZmFzdHJlcGwvZXZhbC9tb2RlbC9sbG1faGVhZF9jb3QucHk=) | `0.00% <0.00%> (ø)` | | | [fastrepl/eval/model/others.py](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl#diff-ZmFzdHJlcGwvZXZhbC9tb2RlbC9vdGhlcnMucHk=) | `0.00% <0.00%> (ø)` | | | [fastrepl/utils/console.py](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl#diff-ZmFzdHJlcGwvdXRpbHMvY29uc29sZS5weQ==) | `0.00% <ø> (ø)` | | | [fastrepl/eval/evaluator.py](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl#diff-ZmFzdHJlcGwvZXZhbC9ldmFsdWF0b3IucHk=) | `16.66% <18.75%> (-19.05%)` | :arrow_down: | | [fastrepl/runner.py](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl#diff-ZmFzdHJlcGwvcnVubmVyLnB5) | `40.62% <50.00%> (-3.13%)` | :arrow_down: | | [fastrepl/eval/model/llm\_head.py](https://app.codecov.io/gh/fastrepl/fastrepl/pull/114?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=fastrepl#diff-ZmFzdHJlcGwvZXZhbC9tb2RlbC9sbG1faGVhZC5weQ==) | `67.77% <52.17%> (-1.38%)` | :arrow_down: |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.