search

zjunlp / EasyEdit

[知识编辑] [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
https://zjunlp.github.io/project/KnowEdit
MIT License
1.63k stars 200 forks source link

ROME test #282

Closed SXxinxiaosong closed 1 month ago

SXxinxiaosong commented 1 month ago

您好，对于ROME模型我有一个问题： ROME的test似乎是修改一条，计算一次acc，最后计算平均值。并且没有保存最终的模型。 为什么不是在最终的模型，在edit set上重新推理进行评测？因为之后的编辑会影响目前编辑的效果，当前编辑成功，没准经过之后的编辑后，当前这条就推理失败了？ 谢谢~

XeeKee commented 1 month ago

Hello, thank you very much for your interest in EasyEdit. The setting you mentioned should be the 'continue' setting. You can set 'sequential edit' to true, so that the final model will contain the results of each edit.

SXxinxiaosong commented 1 month ago

谢谢您的回复。好像没有找到sequential edit这个参数？

XeeKee commented 1 month ago

Have you updated to the latest EasyEdit code? If so, set the editor.edit() function accordingly

SXxinxiaosong commented 1 month ago

好的好的谢谢！我需要更新一下~