Integer GEMM - Githubissues

flame / blis

BLAS-like Library Instantiation Software Framework

Other

2.2k stars 361 forks source link

Integer GEMM #407

Open guillaumekln opened 4 years ago

guillaumekln commented 4 years ago

Are there any plans to include an integer GEMM API in the future? 8-bit or 16-bit integer GEMM have become fairly standard for inference of quantized neural networks.

Here are some examples in other libraries:

Intel MKL
oneDNN
FBGEMM

Thanks!

fgvanzee commented 4 years ago

@guillaumekln Thanks for your interest in BLIS. Unfortunately, we don't have the resources at this time to investigate integer support for the gemm operation. We may look into this more seriously at some point in the future, but I'm not sure when that would be.