search

microsoft / VPTQ

VPTQ, A Flexible and Extreme low-bit quantization algorithm
MIT License
525 stars 34 forks source link

Llama-2-7b models #26

Closed laomao0 closed 1 month ago

laomao0 commented 1 month ago

Can you share Llama-2-7b models? Thanks.

OpenSourceRonin commented 1 month ago

Hi @laomao0, I am trying to reproduce the results on llama-2; please wait for us. I will release models at VPTQ-community .

Can you share Llama-2-7b models? Thanks.

laomao0 commented 1 month ago

Hi @laomao0, I am trying to reproduce the results on llama-2; please wait for us. I will release models at VPTQ-community .

Can you share Llama-2-7b models? Thanks.

thanks

OpenSourceRonin commented 1 month ago

Hi @laomao0,

I have successfully reproduced most of the results from the tech report. Please refer to reproduced collection for details.

The results I reproduced are for reference only, and you should be responsible for application and use.

Thanks!

OpenSourceRonin commented 1 month ago

Hi @laomao0, By the way, could you help me delete your reply containing the malware URL? It seems that GitHub has already deleted the original post, but the URL still exists in your reply. I would like to avoid spreading any malware.

YangWang92 commented 1 month ago

Remove the malware URL from bots.