empirical-run / empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
https://docs.empirical.run
MIT License
147 stars 12 forks source link

feat: add fireworks model provider #69

Closed arjunattam closed 5 months ago

changeset-bot[bot] commented 5 months ago

🦋 Changeset detected

Latest commit: 61159ffdaff62b97e73be16d9a156e74c3890a62

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 4 packages | Name | Type | | -------------------- | ----- | | @empiricalrun/ai | Minor | | @empiricalrun/core | Patch | | @empiricalrun/scorer | Patch | | @empiricalrun/cli | Patch |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

arjunattam commented 5 months ago

fyi the example run is failing because we're running an older version of the cli package (directly from npm) - which does not set the GITHUB_OUTPUT variable