search

neuralmagic / sparseml

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Apache License 2.0
2.01k stars 140 forks source link

Fixes for sparseml.evaluate #2292

Closed Satrat closed 1 month ago

Satrat commented 1 month ago

Imports were out of date, and we were displaying error messages from pre forkless transformers.

Testing

previously failed with an import error, now runs to completion as expected after installing lm-eval

sparseml.evaluate /network/sadkins/llama1.1b_W4A16_channel_compressed -d wikitext -i lm-evaluation-harness