Stability-AI / lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.
MIT License
145 stars 47 forks source link

Add autoGPTQ installation instructions #98

Closed webbigdata-jp closed 1 year ago

webbigdata-jp commented 1 year ago

I noticed that the installation of gptq sometimes fails.
If you do not manually install gekko, the autoGPTQ installation may fail.
Even if you modify setup.py, it will fail because autoGPTQ installation is executed first.

You can check the behavior below.
Stability_AI_lm_evaluation_harness_gptq_example

webbigdata-jp commented 1 year ago

@mkshing It's just a README fix, so I'd be happy to do a quick check and merge!

mkshing commented 1 year ago

@webbigdata-jp thank you!!