Benchmark CALM for Decoder-Only models at 4-bit precision - Githubissues

NolanoOrg / cformers

SoTA Transformers with C-backend for fast inference on your CPU.

MIT License

311 stars 29 forks source link

Benchmark CALM for Decoder-Only models at 4-bit precision #4

Open Ayushk4 opened 1 year ago

Ayushk4 commented 1 year ago

Refer https://arxiv.org/abs/2207.07061