ReaLLMASIC / nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.
MIT License
23 stars 17 forks source link

Quest: Add Quantization Aware Training and Inference #125

Open gkielian opened 6 months ago

gkielian commented 6 months ago

https://pytorch.org/docs/stable/quantization.html