ahrefs / ocannl

OCANNL: OCaml Compiles Algorithms for Neural Networks Learning
BSD 2-Clause "Simplified" License
67 stars 2 forks source link

Support quantization for optimizers: low-bit optimizers #271

Open lukstafi opened 4 months ago

lukstafi commented 4 months ago

https://github.com/pytorch/ao/tree/main/torchao/prototype/low_bit_optim https://x.com/marksaroufim/status/1809398186198593566