search

zjunlp / EasyEdit

[知识编辑] [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
https://zjunlp.github.io/project/KnowEdit
MIT License
1.64k stars 200 forks source link

support KE model for llama-7B #122

Closed quqxui closed 5 months ago

quqxui commented 7 months ago

Hi, Do you plan to support KE model editing with llama as the Backbone? I only found hparams of T5 and GPT-J.

zxlzr commented 7 months ago

Hi, we found supporting KE for llama-7B is quite difficult, but we will try it later.

Happy new year.

JZSAWYER commented 5 months ago

Hi, we found supporting KE for llama-7B is quite difficult, but we will try it later.

Happy new year.

Hi, i wonder how you apply KE to MLLMs (BLIP2,minigpt etc.) since their LLM heads are also llama-based. I didn't find the codes or hparams of KE on MLLMs in your repo as well. thx

tbozhong commented 5 months ago

We run KE using the official code; however, EasyEdit currently does not support it. Support for KE will be considered in future updates.

According to our paper's findings, it can be observed that the performance of KE in editing on llama-based MLLM (e.g. MiniGPT-4) is also unsatisfactory.

zxlzr commented 5 months ago

Hi, we would like to close this issue since we found supporting KE in EasyEdit is a bit complicated now. You can run KE with the code in https://github.com/nicola-decao/KnowledgeEditor. At the same time, we also welcome you to explore adding KE to EasyEdit and provide corresponding PR, etc. Thank you again for your attention.