nightdessert Retrieval_Head issues - Githubissues

nightdessert / Retrieval_Head

open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality

https://arxiv.org/abs/2404.15574

156 stars 13 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Question about blocking an attention head

#9 cnlnpjhsy opened 3 months ago
0
Errors with Phi3 models and how to run the code with the model Yi-6B-200K?

#8 HayeonLee opened 3 months ago
0
Add phi3 support

#7 Wangmerlyn closed 3 months ago
0
Empty JSON Files in results/graph/llama-2-7b-80k.zip

#6 Mor-Li closed 3 months ago
0
unexpected keyword argument 'block_list'

#5 yuhuanyuan opened 4 months ago
2
About data for haystack_for_detect

#4 kenoharada closed 5 months ago
2
Difference between real_needle and needle in needle.jsonl?

#3 zhongmz closed 6 months ago
2
few samples can stably detect retrieval heads?

#2 ZetangForward closed 5 months ago
3
some typing errors

#1 yonghongwu closed 6 months ago
1