empirical-run / empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
https://docs.empirical.run
MIT License
148 stars 13 forks source link

feat: accept timeout as parameter in empiricalrc.json #119

Closed KaustubhKumar05 closed 6 months ago

KaustubhKumar05 commented 6 months ago

Supported by:

TODO

changeset-bot[bot] commented 6 months ago

🦋 Changeset detected

Latest commit: 60cc342a0be418f646ffc805bacd586ef7a58603

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 5 packages | Name | Type | | -------------------- | ----- | | @empiricalrun/ai | Minor | | @empiricalrun/types | Patch | | @empiricalrun/core | Patch | | @empiricalrun/scorer | Patch | | @empiricalrun/cli | Patch |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

github-actions[bot] commented 6 months ago

Empirical Run Summary

Stats Run #6e8b: mistral-tiny
outputs 0%
is-json 0%

Total dataset samples: 2

Error: Some outputs were not generated successfully AI202: process.env.MISTRAL_API_KEY is not set