search

bytedance / ABQ-LLM

An acceleration library that supports arbitrary bit-width combinatorial quantization operations
Apache License 2.0
102 stars 6 forks source link

The link to model zoo #7

Open RanchiZhao opened 1 week ago

RanchiZhao commented 1 week ago

hi! where is the pre-trained ABQ-LLM model zoo?

zengchao0424 commented 3 days ago

hi! where is the pre-trained ABQ-LLM model zoo?

hello, we will release the quantized models mentioned in the paper, pending internal company approval. We will share the HF link soon.