Open riverliuintel opened 1 month ago
Integrate oneDNN GEMM INT4 kernels, and serves for Torchao LLM usage. It requires pass UT and example workloads usage.
No response
🚀 The feature, motivation and pitch
Integrate oneDNN GEMM INT4 kernels, and serves for Torchao LLM usage. It requires pass UT and example workloads usage.
Alternatives
No response
Additional context
No response