search

zjunlp / EasyEdit

[知识编辑] [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
https://zjunlp.github.io/project/KnowEdit
MIT License
1.63k stars 200 forks source link

llama2-7b-chat data is not reproducible #283

Closed kailinjiang closed 1 month ago

kailinjiang commented 1 month ago

image

I reproduced the results of your paper on llama2-7b-chat, and found that it was impossible to reproduce the data, and the data were very different. I used the json file after each run_knowedit_llama2.py calculation, and the data set I used each time was test data. Hope to get your reply!

zxlzr commented 1 month ago

Could you please report the details of your settings and results, dataset and metric, so we can help you.

zxlzr commented 1 month ago

I found you have submitted many issues and thank you for your interests in EasyEdit and knowledge editing, maybe you can add the WeChat so we can make communication more convenient.

kailinjiang commented 1 month ago

非常感谢 我已经添加您的微信了