search

alan-turing-institute / prompto

An open source library for asynchronous querying of LLM endpoints
https://alan-turing-institute.github.io/prompto/
MIT License
18 stars 1 forks source link

Automatic judge #96

Closed rchan26 closed 2 weeks ago

rchan26 commented 3 weeks ago

See #95 which got closed by accident

codecov-commenter commented 3 weeks ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 63.17%. Comparing base (a05506f) to head (59d8f4b). Report is 23 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #96 +/- ## =========================================== + Coverage 52.41% 63.17% +10.75% =========================================== Files 38 39 +1 Lines 1984 2102 +118 =========================================== + Hits 1040 1328 +288 + Misses 944 774 -170 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

rchan26 commented 2 weeks ago

thanks for reviewing @EdwinB12 . I'll add some docs now for this and for #94

edit: have just put placeholders in for now to make this PR a bit more manageable and make a new PR where I implement the auto scoring from CLI (see #83)