Closed uygarkurt closed 3 months ago
Thank you for your attention. We are currently busy with the NeurIPS submission, we will address this matter by the end of the month.
The issue you are concerned with is actually the generalization of editing, from simple editing prompts to the generation of complex queries. This is a problem that many current works have not yet resolved (including the PMET you are using). For more details, you can refer to this paper: https://arxiv.org/abs/2402.09394.
Additionally, are the editing metrics functioning correctly on your end? Have you enabled sequential editing?
hi, have you solved your issue yet?
Hey. Couldn't look again yet. I'll try and update. Thank you!
Hi, thank you for this amazing work!
I'm trying to edit
NousResearch/Llama-2-7b-chat-hf
using PMET. I'm following the samples you provided. However it gives exactly the same answer for both the original and the edited model. I use the example which you change profession ofGrant Hill
from basketball player to football player.When I ask
Who is Grant Hill?
, the original model provides the following answer:The edited model gives the following answer:
I was able to edit
GPT-2XL
using this. I was also able to editLlama
using MEMIT. However, PMET with Llama didn't work. II'm attaching the codes I used.edit.py
llama-7b.yaml
At least I get the results with the following code