search

openai / evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Other
14.76k stars 2.58k forks source link

Make the torch dep optional #1524

Closed etr2460 closed 5 months ago

etr2460 commented 5 months ago

torch was added in https://github.com/openai/evals/pull/1496, but it's very heavy and only required for one eval. Let's move it to an optional-dependency