issues
search
RyanSelesnik
/
AI-Toy
0
stars
0
forks
source link
Quantise models
#18
Open
RyanSelesnik
opened
1 year ago
RyanSelesnik
commented
1 year ago
Links
8-bit qunatisation
A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using Hugging Face Transformers, Accelerate and bitsandbytes
Links