empirical-run empirical issues

empirical-run / empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application

https://docs.empirical.run

MIT License

149 stars 13 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

chore: update package versions for release

#39 github-actions[bot] closed 7 months ago
0
ci: fix release version generation gh action

#38 saikatmitra91 closed 7 months ago
1
feat: add changeset and version publish process

#37 saikatmitra91 closed 7 months ago
1
feat: add stats summary

#36 saikatmitra91 closed 7 months ago
1
feat: simplify inputs to be an object with kv pairs

#35 arjunattam closed 7 months ago
0
chore: remove force build in dev watch mode

#34 saikatmitra91 closed 7 months ago
0
feat: open the ui web app when ready

#33 arjunattam closed 7 months ago
0
feat: dataset loaders and auto-fill for missing ids

#32 arjunattam closed 7 months ago
1
docs: color scheme

#31 arjunattam closed 7 months ago
0
feat: add error handling

#30 saikatmitra91 closed 7 months ago
0
docs: initialize docs with mintlify and update readme

#29 arjunattam closed 7 months ago
0
feat: add message tooltip in while showing scores in UI

#28 saikatmitra91 closed 7 months ago
0
chore: add pr message lint github action

#27 saikatmitra91 closed 7 months ago
0
Add RAG pipeline evaluation example and run script executor

#26 saikatmitra91 closed 7 months ago
0
feat: clean up interface to accommodate script runs

#25 saikatmitra91 closed 7 months ago
0
feat: anthropic provider

#24 KaustubhKumar05 closed 7 months ago
0
chore: prepare script for humaneval dataset

#23 arjunattam closed 7 months ago
0
feat: timeout and error reporting for py-script eval

#22 arjunattam closed 7 months ago
0
chore: add lint to gh and package manager version management

#21 saikatmitra91 closed 7 months ago
0
fix: humaneval prompt and eval updated

#20 arjunattam closed 7 months ago
0
feat: add ai package

#19 saikatmitra91 closed 7 months ago
0
feat: python eval script for humaneval

#18 arjunattam closed 7 months ago
0
chore: clickable link for ui command

#17 arjunattam closed 7 months ago
0
feat: load dataset from files

#16 arjunattam closed 7 months ago
0
feat: add library code generator command

#15 saikatmitra91 closed 7 months ago
0
feat: introduce model graded evals

#14 arjunattam closed 7 months ago
0
feat: add results table view

#13 saikatmitra91 closed 7 months ago
0
feat: add ui support for run results

#12 saikatmitra91 closed 7 months ago
0
feat(cli): add progress bar

#11 arjunattam closed 7 months ago
0
feat: support http path in dataset

#10 arjunattam closed 7 months ago
0
feat: save run results support

#9 saikatmitra91 closed 7 months ago
0
feat: add basic example

#8 arjunattam closed 7 months ago
0
feat(evals): add sql syntax and semantic

#7 arjunattam closed 7 months ago
0
feat: add components support to web app

#6 saikatmitra91 closed 7 months ago
0
test: setup vitest

#5 arjunattam closed 7 months ago
0
fix: README brand logo not loading

#4 saikatmitra91 closed 7 months ago
0
feat: add basic watch setup for packages

#3 saikatmitra91 closed 7 months ago
0
feat: add tailwindcss, shadcn

#2 KaustubhKumar05 closed 7 months ago
0
feat: add initial setup

#1 saikatmitra91 closed 7 months ago
0