How to detemine which hparam layers

kmeng01 / memit

Mass-editing thousands of facts into a transformer memory (ICLR 2023)

https://memit.baulab.info

MIT License

438 stars 53 forks source link

Open Miraclemarvel55 opened 4 months ago

Miraclemarvel55 commented 4 months ago

Great Job. I run some code of this repo. After casual trace I dont know which layer is import for knowledge storage. Is that only heuristic?

MstarLioning commented 2 months ago

您好，冒昧打扰。请问MEMIT这篇文章您配置好环境了么？我想请问下下载下来的协方差权重应该放在什么位置？谢谢！