search

microsoft / BitBLAS

BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
MIT License
190 stars 21 forks source link

[DEV] Remove extra dependencies and refactor the tvm import. #16

Closed LeiWang1999 closed 2 months ago

LeiWang1999 commented 2 months ago

As we use 3rdparty tvm in our codebase, and the tvm is dynamically import from the bitblas init stage, so the tvm should be import after bitblas.