search

kmeng01 / memit

Mass-editing thousands of facts into a transformer memory (ICLR 2023)
https://memit.baulab.info
MIT License
434 stars 53 forks source link

How to deal with multi-token target? #20

Open tuanvu92 opened 2 months ago

tuanvu92 commented 2 months ago

Hi,

When using causal tracing to locate the critical layesr, it seems that the target have to be a single token. Do you have any ideas how to apply causal tracing for target that spans several tokens? For example: "Seoul is the capital of South Korea"

MstarLioning commented 1 month ago

Hello, have you set up the environment for the MEMIT paper? I would like to ask where the downloaded covariance weights should be placed. Thank you!