search

microsoft / T-MAC

Low-bit LLM inference on CPU with lookup table
MIT License
588 stars 44 forks source link

How can I test the performance of a single matrix multiplication in tmac? thanks #49

Closed lijianxing123 closed 1 month ago

kaleid-liner commented 2 months ago

You can use tools/profile.py. See https://github.com/microsoft/T-MAC/issues/44#issuecomment-2349601221