search

AkariAsai / self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.
https://selfrag.github.io/
MIT License
1.76k stars 162 forks source link

What does YOUR_INPUT_FILE look like? Can you provide an example? Thanks very much! #65

Open XiaozhuLove opened 5 months ago

XiaozhuLove commented 5 months ago

cd retrieval_lm python passage_retrieval.py \ --model_name_or_path facebook/contriever-msmarco --passages psgs_w100.tsv \ --passages_embeddings "wikipedia_embeddings/*" \ --data YOUR_INPUT_FILE \ --output_dir YOUR_OUTPUT_FILE \ --n_docs 20

innovation64 commented 5 months ago

cd retrieval_lm python passage_retrieval.py --model_name_or_path facebook/contriever-msmarco --passages psgs_w100.tsv --passages_embeddings "wikipedia_embeddings/*" --data YOUR_INPUT_FILE --output_dir YOUR_OUTPUT_FILE --n_docs 20

its script has some problems, it doesn't have --data argument, only has --dataset or --query, you need change it ,and i try to run it just by simple jsonl or json file with questions @XiaozhuLove