search

zjunlp / EasyEdit

[知识编辑] [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
https://zjunlp.github.io/project/KnowEdit
MIT License
1.63k stars 200 forks source link

Can i edit quantized model? #314

Closed orgilj closed 4 weeks ago

orgilj commented 4 weeks ago

How to edit quantized models? please provide me some examples. thank you

XeeKee commented 4 weeks ago

https://github.com/zjunlp/EasyEdit/blob/df6c2108cf373263fc32310f1413993245bc5977/easyeditor/editors/editor.py#L65 You can quantize during model loading in the above-mentioned locations.