search

neuralmagic / sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Apache License 2.0
2.07k stars 148 forks source link

Fixes for sparseml.evaluate #2292

Closed Satrat closed 6 months ago

Satrat commented 6 months ago

Imports were out of date, and we were displaying error messages from pre forkless transformers.

Testing

previously failed with an import error, now runs to completion as expected after installing lm-eval

sparseml.evaluate /network/sadkins/llama1.1b_W4A16_channel_compressed -d wikitext -i lm-evaluation-harness