neulab / knn-transformers

PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT
MIT License
269 stars 23 forks source link

add web demo #2

Open AK391 opened 2 years ago

AK391 commented 2 years ago

added web demo to Hugging Face using Gradio

urialon commented 2 years ago

Hi @AK391 , Thank you for your efforts!

However, adding a web demo for the model distilgpt2-finetuned-wikitext103 kind of misses the point: the distilgpt2-finetuned-wikitext103 model is a completely standard model, which our code wraps and integrates retrieved examples at test time.

I'm not sure that there is an easy way to demonstrate that at huggingface spaces, because our code is needed to search for nearest neighbor examples and integrate them.

What do you think? Am I missing anything?