prep.py lacks modules import

jzbjyb / FLARE

Forward-Looking Active REtrieval-augmented generation (FLARE)

MIT License

545 stars 50 forks source link

prep.py lacks modules import #3

Closed baochi0212 closed 11 months ago

baochi0212 commented 1 year ago

what is models module imported in prep.py ?

DongdongY1 commented 1 year ago

I suppose "models" should be changed to "src" as you will find all the requisites in folder "src". However, even changing this cannot enable index to be built properly. Too many bugs...

jzbjyb commented 11 months ago

Sorry for the late reply and the bugs I made when I release the code! I just fixed the bugs in the prep.py file. Now it should be able to index the wikipedia documents with the following command:

python prep.py --task build_elasticsearch --inp data/dpr/psgs_w100.tsv wikipedia_dpr