[Evaluator] Implementation of `lm-evaluation-harness` integration

neuralmagic / deepsparse

Sparsity-aware deep learning inference runtime for CPUs

https://neuralmagic.com/deepsparse/

Other

2.98k stars 172 forks source link

Closed dbogunowicz closed 10 months ago

dbogunowicz commented 10 months ago

Implements the first evaluation integration for the DeepSparse Evaluation API: https://github.com/EleutherAI/lm-evaluation-harness