search

facebookresearch / atlas

Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03299)
Other
517 stars 67 forks source link

Example training script for the KILT task #19

Closed La-SilverLand closed 1 year ago

La-SilverLand commented 1 year ago

hi, for the KILT task, you mentioned in the README that "Train/validation/test data for this task should consist of jsonl files, which should be passed to train.py as --train_data train_file_1.jsonl train_file_2.jsonl, and --eval_data eval_file_1.jsonl eval_file_2.jsonl etc. " and "Atlas will automatically process these instances appropriately, into Atlas] query inputs based on the input field and target generations based on the answer fields", yet i didn't find the dedicated KILT data preprocessing code in the project, and passing two json files to the train.py is not straight forward enough to follow. and as you mentioned in https://github.com/facebookresearch/atlas/issues/13, there won't be checkpoints provided for Atlas fine-tuned on KILT would you plz kindly off a example complete training script for fine-tuning Atlas on KILT, thanks in advance

mlomeli1 commented 1 year ago

Hi @La-SilverLand , you can download the KILT data from the KILT repository: https://github.com/facebookresearch/KILT

La-SilverLand commented 1 year ago

hi, i've already got the data, i'm not very sure about the training script