v7labs / benchllm

Continuous Integration for LLM powered applications
https://www.benchllm.com
MIT License
228 stars 10 forks source link

Adds PipeEvaluator #8

Open simedw opened 1 year ago

simedw commented 1 year ago

Let's you chain multiple evaluators together, main reason is to first try cheap and faster evaluator, such as string-match, and only if they fail go for more expensive ones like semantic similarity.