issues

search

RyanSelesnik / AI-Toy

0 stars 0 forks source link

Quantise models #18

Open RyanSelesnik opened 1 year ago

RyanSelesnik commented 1 year ago

Links

8-bit qunatisation
A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using Hugging Face Transformers, Accelerate and bitsandbytes

© Githubissues.
Githubissues is a development platform for aggregating issues.