refactor: strict output for gpt-4o-08-06 and add avg results - Githubissues

abcsys / libem

Compound AI toolchain for fast and accurate entity matching, powered by LLMs.

https://libem.org

Apache License 2.0

19 stars 3 forks source link

refactor: strict output for gpt-4o-08-06 and add avg results #92

Closed daiwaid closed 2 months ago

daiwaid commented 2 months ago

What this PR does / why we need it:

add column average to benchmark suites and readme tables
fix: remove classic.challenging from benchmark suite dataset

Which issue(s) this PR addresses (if any):

Addresses #

Special notes for your reviewer:

Does this PR introduce a user-facing change?

 - update benchmark readme