search

tonychenxyz / selfie

This repository contains the code and data for the paper "SelfIE: Self-Interpretation of Large Language Model Embeddings" by Haozhe Chen, Carl Vondrick, and Chengzhi Mao.
29 stars 2 forks source link

How to get 'converted_weights_llama_chat7b'? #4

Open HiHqqqq opened 3 months ago

HiHqqqq commented 3 months ago

Hi! I really like this work. Could you please tell me how to get 'converted_weights_llama_chat7b' used in Supervised Controls.ipynb? I tried supervised controls with llama2-7b-chat-hf, but the results differ from that provided in Supervised Controls.ipynb.

tonychenxyz commented 3 months ago

Hi! llama2-7b-chat-hf should be the right one to use. Could you provide more information about how the results differ?

I got converted_weights_llama_chat7b from the old meta model downloading process of downloading their format first and then converted to huggingface format.