search

empirical-run / empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
https://docs.empirical.run
MIT License
146 stars 11 forks source link

fix: py-script execute's return type should be consistent with scorer… #125

Closed KaustubhKumar05 closed 4 months ago

changeset-bot[bot] commented 4 months ago

🦋 Changeset detected

Latest commit: 87103bb3509bc6f88c87f84b7dccc929df08b11f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 2 packages | Name | Type | | ------------------ | ----- | | @empiricalrun/core | Minor | | @empiricalrun/cli | Patch |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

github-actions[bot] commented 4 months ago

Empirical Run Summary

Stats Run #8bb0: gpt-3.5-turbo Run #30ed: gpt-4-turbo-preview
outputs 100% 100%
is-json 100% 100%

Total dataset samples: 2