-
I am trying to build on your knn-transfomers [repo](https://github.com/neulab/knn-transformers/tree/master?tab=readme-ov-file).
When I run the distill gpt with the given setup in the repo but with …
-
# 🌟 Adding the kNN-LM and kNN-MT models
## Model description
The kNN [Language Model](https://arxiv.org/pdf/1911.00172.pdf) and [Machine Translation](https://arxiv.org/pdf/2010.00710.pdf) levera…
-
Hello! It's really an excellent work! Thanks for releasing the huggingface `transformers` based version. Recently, I'm doing experiments on some other datasets. Unfortunately, I met some problems when…
-
Hi, can I ask a question regarding the evaluating kNN-LM and RetoMaton? I used the preprocessed Wikitext-103 datastores and FAISS index from gpt-2 and distilgpt-2(downloading form the link) and encoun…
-
Hi, @urialon
Thanks for your great work.
I just tested `neulab/gpt2-large-finetuned-wikitext103` without and with `--knn` but could not observe an improvement...
ppl 10.5565 vs ppl 10.6538
Any i…
-
Is it possible to modify the database for the automaton during inference time, i.e. add new data on-the-fly? Or do we need to reconstruct the automaton whenever the database changes?
I was wonderin…