How to train the model using Baidu dataset(transfer to squad format)?

AmoseKang / DrQA_cn

Other

37 stars 22 forks source link

How to train the model using Baidu dataset(transfer to squad format)? #3

Closed xyz8 closed 6 years ago

xyz8 commented 6 years ago

How to train the model using Baidu dataset, and how to tranfer baidu origin dataset to the data in your BaiduYun(squad format)) ? Thank you.

what's more, when i run sinteractive.py and test the example in your readme process("西交图书馆的全名？", doc_n=1, net_n=3) an error occur: requests.exceptions.TooManyRedirects: Exceeded 30 redirects so how to solve this problem? thank you

AmoseKang commented 6 years ago

try delete retrieve from net method, maybe something went wrong with the spider code.

AmoseKang commented 6 years ago

to train a model, use/scripts/reader/train.py. There are sample commands in the file. Thanks for your commit but i can't provide a tfidf model currently. However, you can train a model with yourself using codes in /scripts/retriever/ .

smalon commented 6 years ago

can you possible leave a contact like email or else? i was trying to do the same thing: applying it into a campany confluence so that one can get an answer directly instead of human work. can we discuss it on email?