empirical-run / empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
https://docs.empirical.run
MIT License
148 stars 13 forks source link

feat: add js and ts config support #218

Closed saikatmitra91 closed 4 months ago

changeset-bot[bot] commented 4 months ago

🦋 Changeset detected

Latest commit: 9657a8e0c877157b48981a5867b86183f6d83a37

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 6 packages | Name | Type | | ------------------------------- | ----- | | empiricalrun | Minor | | @empiricalrun/json-schema | Minor | | @empiricalrun/types | Minor | | @empiricalrun/typescript-config | Patch | | web | Patch | | @empiricalrun/scorer | Patch |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

github-actions[bot] commented 4 months ago

Empirical Run Summary

Run #f0a0: gpt-3.5-turbo Run #af48: gpt-4-turbo-preview
Outputs 100% 100%
Scores
json-syntax 100% 100%
Avg latency 1310ms 1255ms

Total dataset samples: 2