search

empirical-run / empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
https://docs.empirical.run
MIT License
141 stars 10 forks source link

feat: add empiricalrun create package to initialise ts/js config #222

Closed saikatmitra91 closed 1 month ago

changeset-bot[bot] commented 1 month ago

🦋 Changeset detected

Latest commit: 1fa685ba90b0d57080b84536269f143f1997c375

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package | Name | Type | | ------------------- | ----- | | create-empiricalrun | Minor |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

github-actions[bot] commented 1 month ago

Empirical Run Summary

Run #cab6: gpt-3.5-turbo Run #71ba: gpt-4-turbo-preview
Outputs 100% 100%
Scores
json-syntax 100% 100%
Avg latency 714ms 1013ms

Total dataset samples: 2