decoupleQ.decoupleQ_kernels

bytedance / decoupleQ

A quantization algorithm for LLM

Apache License 2.0

94 stars 5 forks source link

decoupleQ.decoupleQ_kernels #11

Open hsb1995 opened 3 months ago

hsb1995 commented 3 months ago

Dear professor, your work is excellent and the workload is very full. We are planning to reproduce your code and feel that the core package of the code is missing. Could you please answer this question?

We searched on pypi and found that the package was not available. And there was no response to directly ping this package, what is the situation.

Nekofish-L commented 3 months ago

modify build.sh based on your system and run bash build.sh.