issues
search
empirical-run
/
empirical
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
https://docs.empirical.run
MIT License
141
stars
10
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Google Vertex AI Integration Idea
#236
arjunattam
opened
1 month ago
2
docs: update demo video
#234
arjunattam
closed
1 month ago
1
docs: update for js/ts config
#233
arjunattam
closed
1 month ago
1
chore: update package versions for release
#232
github-actions[bot]
closed
1 month ago
0
chore(deps): bump requests from 2.31.0 to 2.32.0 in /examples/rag
#231
dependabot[bot]
closed
1 month ago
1
feat: add support for js functions as scorer
#230
saikatmitra91
closed
1 month ago
2
feat: deprecate init command
#229
saikatmitra91
closed
1 month ago
1
docs: add readme for create-empiricalrun package
#228
saikatmitra91
closed
1 month ago
1
chore: update package versions for release
#227
github-actions[bot]
closed
1 month ago
0
fix: reduce package size of empiricalrun CLI
#226
saikatmitra91
closed
1 month ago
1
chore: update package versions for release
#225
github-actions[bot]
closed
1 month ago
0
docs: update docs with new empirical CLI package name
#224
saikatmitra91
closed
1 month ago
1
fix: packages of js-script-example
#223
saikatmitra91
closed
1 month ago
2
feat: add empiricalrun create package to initialise ts/js config
#222
saikatmitra91
closed
1 month ago
2
chore: update package versions for release
#221
github-actions[bot]
closed
1 month ago
0
fix: google ai provider throwing 503 service unavailable
#220
saikatmitra91
closed
1 month ago
1
chore: update package versions for release
#219
github-actions[bot]
closed
1 month ago
0
feat: add js and ts config support
#218
saikatmitra91
closed
1 month ago
2
docs: tool calling and improvement to models section
#217
arjunattam
closed
1 month ago
2
fix: latency calculation for claude, gemini, gpt chat
#216
arjunattam
closed
1 month ago
2
feat: add support for grouping inputs
#215
saikatmitra91
closed
1 month ago
2
chore(deps): bump jinja2 from 3.1.3 to 3.1.4 in /examples/rag
#214
dependabot[bot]
closed
1 month ago
1
Version Packages
#213
github-actions[bot]
closed
1 month ago
0
docs: add support for JSON dataset
#212
saikatmitra91
closed
1 month ago
1
fix: tool dataset
#211
saikatmitra91
closed
2 months ago
2
fix: handle rate_limit_exceeded in openai assistants
#210
arjunattam
closed
2 months ago
1
docs: openai assistants
#209
arjunattam
closed
1 month ago
1
chore: update package versions for release
#208
github-actions[bot]
closed
2 months ago
0
fix: allow azure base url
#207
arushsharma24
closed
2 months ago
1
chore(deps): bump tqdm from 4.66.2 to 4.66.3 in /examples/rag
#206
dependabot[bot]
closed
2 months ago
1
fix: cli summary shows all run-specific scores
#205
mukeshblackhat
closed
2 months ago
2
fix: overlapping outputs
#204
saikatmitra91
closed
2 months ago
1
feat: add tools support for models
#203
saikatmitra91
closed
2 months ago
2
feat: add support for tools in assistant run config parameters
#202
saikatmitra91
closed
2 months ago
1
fix: output and dataset alignment issues in UI
#201
saikatmitra91
closed
2 months ago
1
feat: add dedicated edit UI for assistant instructions
#200
saikatmitra91
closed
2 months ago
1
feat: add support for tool calls in assistant output
#199
saikatmitra91
closed
2 months ago
1
feat: add target for scorers
#198
saikatmitra91
closed
2 months ago
1
docs: readme intro and video
#197
arjunattam
closed
2 months ago
1
chore: update package versions for release
#196
github-actions[bot]
closed
2 months ago
0
fix: fireworks errors are absorbed
#195
arjunattam
closed
2 months ago
1
chore: update run telemetry events
#194
arjunattam
closed
2 months ago
1
feat: py-script scorer has a simpler return type
#193
arjunattam
closed
2 months ago
2
fix: add retry logs
#192
saikatmitra91
closed
2 months ago
1
chore: remove sql semantic scorer
#191
arjunattam
closed
2 months ago
1
feat: csv loader should parse numbers
#190
arjunattam
closed
2 months ago
1
chore: update package versions for release
#189
github-actions[bot]
closed
2 months ago
0
chore: add changeset for add support for assistant run config defaults
#188
saikatmitra91
closed
2 months ago
1
ci: auto-upload json schema on npm publish
#187
arjunattam
closed
2 months ago
1
fix: errors with assistant and basic examples
#186
saikatmitra91
closed
2 months ago
2
Next