search

Stability-AI / StableLM

StableLM: Stability AI Language Models
Apache License 2.0
15.84k stars 1.03k forks source link

Running Quantized Model #53

Open RaghavMajorBoost opened 1 year ago

RaghavMajorBoost commented 1 year ago

Hi All,

Does anyone else run into the following error when attempting to run the 8-Bit version of the StableLM notebook? image

Essentially, all I changed was I set the 8-bit flag to True