How to add a new dataset?

jzbjyb / FLARE

Forward-Looking Active REtrieval-augmented generation (FLARE)

MIT License

545 stars 50 forks source link

How to add a new dataset? #4

Open DongdongY1 opened 1 year ago

DongdongY1 commented 1 year ago

I would like to try a new dataset in place of the wiki dump. It seems that I need to compress documents into .tsv format and make some adjustments over code. Could some simple instructions be given?

flatLying commented 9 months ago

yep, could please release some instruction about how to replace wiki data with our own dataset