This PR was opened by the Changesets release GitHub action. When you're ready to do a release, you can merge this and publish to npm yourself or setup this action to publish automatically. If you're not ready to do a release yet, that's fine, whenever you add more changesets to main, this PR will be updated.
Releases
@empiricalrun/ai@0.4.0
Minor Changes
e77b76e: feat: support for gemini 1.5 pro model
9822db6: feat: accept timeout as parameter in empiricalrc.json
Patch Changes
06b1667: chore: change api key name for google models
bbd5cd0: fix: don't retry gemini unless we get a 429 error
2bc5465: fix: minor improvements for execution accuracy in spider example
@empiricalrun/cli@0.5.0
Minor Changes
d087119: feat: add support for dataset using csv and google sheet
a8bc03a: feat: add support for duckdb for filtering and score summary
Patch Changes
036c015: fix: update the tabs UI to a more minimal design
8ffc64e: feat: add or remove samples and run them on the comparison ui
d3a24a6: feat: update scores UI to accomodate score message
2bc5465: fix: minor improvements for execution accuracy in spider example
Updated dependencies [8ffc64e]
Updated dependencies [9822db6]
Updated dependencies [dd7af1f]
Updated dependencies [a8bc03a]
@empiricalrun/types@0.3.2
@empiricalrun/core@0.5.0
@empiricalrun/core@0.5.0
Minor Changes
dd7af1f: fix: py-script execute's return type should be consistent with scorer's return type
Patch Changes
a8bc03a: feat: add support for duckdb for filtering and score summary
Updated dependencies [e77b76e]
Updated dependencies [9822db6]
Updated dependencies [06b1667]
Updated dependencies [5079335]
Updated dependencies [bbd5cd0]
Updated dependencies [b065dad]
Updated dependencies [2bc5465]
@empiricalrun/ai@0.4.0
@empiricalrun/scorer@0.1.5
@empiricalrun/scorer@0.1.5
Patch Changes
5079335: fix: sql syntax scorer should fail for empty output
b065dad: chore: improve message string for valid sql-syntax
2bc5465: fix: minor improvements for execution accuracy in spider example
Updated dependencies [e77b76e]
Updated dependencies [9822db6]
Updated dependencies [06b1667]
Updated dependencies [bbd5cd0]
Updated dependencies [2bc5465]
@empiricalrun/ai@0.4.0
@empiricalrun/types@0.3.2
Patch Changes
8ffc64e: feat: add or remove samples and run them on the comparison ui
9822db6: feat: accept timeout as parameter in empiricalrc.json
web@0.7.0
Minor Changes
8ffc64e: feat: add or remove samples and run them on the comparison ui
a8bc03a: feat: add support for duckdb for filtering and score summary
d3a24a6: feat: update scores UI to accomodate score message
Patch Changes
036c015: fix: update the tabs UI to a more minimal design
2bc5465: fix: minor improvements for execution accuracy in spider example
This PR was opened by the Changesets release GitHub action. When you're ready to do a release, you can merge this and publish to npm yourself or setup this action to publish automatically. If you're not ready to do a release yet, that's fine, whenever you add more changesets to main, this PR will be updated.
Releases
@empiricalrun/ai@0.4.0
Minor Changes
Patch Changes
@empiricalrun/cli@0.5.0
Minor Changes
Patch Changes
@empiricalrun/core@0.5.0
Minor Changes
Patch Changes
@empiricalrun/scorer@0.1.5
Patch Changes
@empiricalrun/types@0.3.2
Patch Changes
web@0.7.0
Minor Changes
Patch Changes