bossjones / goob_ai

MIT License
1 stars 0 forks source link

chg: wip to get evals working #22

Closed bossjones closed 3 months ago

bossjones commented 3 months ago

Summary

WIP to get evals working

Checklist

codecov[bot] commented 3 months ago

Codecov Report

Attention: Patch coverage is 39.70037% with 161 lines in your changes missing coverage. Please review.

Project coverage is 37.17%. Comparing base (c5f0401) to head (c27288f).

Files Patch % Lines
src/goob_ai/goob_bot.py 12.62% 87 Missing and 3 partials :warning:
src/goob_ai/cli.py 0.00% 40 Missing and 1 partial :warning:
src/goob_ai/base.py 66.66% 16 Missing :warning:
src/goob_ai/clients/discord_client/utils.py 50.00% 12 Missing :warning:
src/goob_ai/agent.py 93.33% 1 Missing :warning:
...ob_ai/gen_ai/utilities/agent_criteria_evaluator.py 50.00% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #22 +/- ## ========================================== + Coverage 37.05% 37.17% +0.11% ========================================== Files 59 61 +2 Lines 5305 5530 +225 Branches 720 762 +42 ========================================== + Hits 1966 2056 +90 - Misses 3250 3382 +132 - Partials 89 92 +3 ``` | [Flag](https://app.codecov.io/gh/bossjones/goob_ai/pull/22/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Malcolm+Jones+%28bossjones%2FTony+Dark%29) | Coverage Δ | | |---|---|---| | [3.10](https://app.codecov.io/gh/bossjones/goob_ai/pull/22/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Malcolm+Jones+%28bossjones%2FTony+Dark%29) | `37.17% <39.70%> (+0.11%)` | :arrow_up: | | [Linux](https://app.codecov.io/gh/bossjones/goob_ai/pull/22/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Malcolm+Jones+%28bossjones%2FTony+Dark%29) | `37.17% <39.70%> (+0.11%)` | :arrow_up: | | [X64](https://app.codecov.io/gh/bossjones/goob_ai/pull/22/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Malcolm+Jones+%28bossjones%2FTony+Dark%29) | `37.17% <39.70%> (+0.11%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Malcolm+Jones+%28bossjones%2FTony+Dark%29#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

bossjones commented 3 months ago

almost got it, only issue is it doesn't currently post to thread, it posts to main channel, something simple to fix tomorrow most likely.