empirical-run / empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
https://docs.empirical.run
MIT License
148 stars 13 forks source link

fix: latency calculation for claude, gemini, gpt chat #216

Closed arjunattam closed 4 months ago

arjunattam commented 4 months ago

did not fix for mistral because it is retrying inside the library

changeset-bot[bot] commented 4 months ago

🦋 Changeset detected

Latest commit: e0a20e04eb0d56af18bedbdd2df5dda82544aa20

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 4 packages | Name | Type | | -------------------- | ----- | | @empiricalrun/ai | Patch | | @empiricalrun/core | Patch | | @empiricalrun/scorer | Patch | | @empiricalrun/cli | Patch |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

changeset-bot[bot] commented 4 months ago

🦋 Changeset detected

Latest commit: 3889a010360acca1129156649e0c47c2bd178ce0

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 4 packages | Name | Type | | -------------------- | ----- | | @empiricalrun/ai | Patch | | @empiricalrun/core | Patch | | @empiricalrun/scorer | Patch | | @empiricalrun/cli | Patch |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR