facebookresearch / FiD

Fusion-in-Decoder
Other
536 stars 107 forks source link

Support transformers > 4.1.x and tutorials about using the pretrained model? #5

Open velocityCavalry opened 3 years ago

velocityCavalry commented 3 years ago

Hello,

I was wondering whether you have plans to support transformers > 4.1.x although I know that DPR only works for Huggingface (version <=3.1.0). Also, I am a little bit confused about using the pretrained model, is this the correct command? I am confused about the eval_data.json in particular as the data I downloaded using get_data.sh contains NQ-open.dev.jsonl file, and the nq_passages/dev.json file.

        --model_path pretrained_models/nq_readers_base/ \
        --eval_data open_domain_data/download/NQ-open.dev.jsonl \
        --per_gpu_batch_size 1 \
        --n_context 100 \
        --name my_test \
        --checkpoint_dir checkpoint \

Thanks for any help!

OhadRubin commented 3 years ago

Any update on this issue (regarding the transformers version)?