Error in running Llama 2 generation example

abertsch72 / unlimiformer

Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"

MIT License

1.05k stars 77 forks source link

Error in running Llama 2 generation example #63

Open OswaldHe opened 5 months ago

OswaldHe commented 5 months ago

Hi, I got the following error when I tried to execute the command in the README:

scores, values = faiss.knn_gpu(faiss.StandardGpuResources(), queries, self.keys, k, 
TypeError: torch_replacement_knn_gpu() got an unexpected keyword argument 'device'

I'm using faiss-gpu@1.7.2.