"Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang.
MIT License
21
stars
2
forks
source link
Some question about inference.py on ZeroScrolls #2
1.What device did you use to inference on ZeroScrolls dataset.
2.What is the input prompt length do you use when inferencing which is not mentioned in your paper ?
1.What device did you use to inference on ZeroScrolls dataset. 2.What is the input prompt length do you use when inferencing which is not mentioned in your paper ?