Enable matmul function - Githubissues

ROCm / bitsandbytes

8-bit CUDA functions for PyTorch

MIT License

38 stars 4 forks source link

Enable matmul function #13

Closed pnunna93 closed 8 months ago

pnunna93 commented 8 months ago

This PR enables matmul function on ROCm. It has following fixes:

Enables igemmlt in matmul function
Fix for output shape in transform function
Enables int8 output for igemmlt
col format support for extract outliers function
row format support for dequant mm kernel