search

GreenBitAI / green-bit-llm

A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
https://huggingface.co/blog/NicoNico/green-bit-llm
Apache License 2.0
70 stars 7 forks source link

About the NAS method #18

Closed hanhanpp closed 3 months ago

hanhanpp commented 3 months ago

Hi, Does the NAS -based quantization method released? I want to learn how to quant a model by the proposed NAS method.

yanghaojin commented 3 months ago

Thanks for your interests!

As this technology is still under further improvement, we are not yet fully ready to release our quantization pipeline. However, we will upgrade the LLAMA3 and Qwen2 models soon, and the accuracy of the quantization models will be significantly improved. Please stay tuned.

BR HJ