search

facebookresearch / KILT

Library for Knowledge Intensive Language Tasks
MIT License
894 stars 90 forks source link

Custom Dataset #26

Closed ajay01994 closed 3 years ago

ajay01994 commented 3 years ago

Hi Team ,

Firstly thanks a lot for releasing KILT , its a very useful library and appreciate your hard work made in developing it , I wish to ask 2 questions WRT tool .

  1. How to load the latest Wikipedia dump any scripts or latest dataset you have or you plan to release anytime soon ?

  2. How to load our own custom dataset in KILT for all Tasks mentioned in the KILT library?

Looking forward for your response

Thanks & Regards

Ajay Sahu

fabiopetroni commented 3 years ago

Hey @ajay01994.

we just added an example script to map a dataset to KILT format - see https://github.com/facebookresearch/KILT/blob/master/scripts/map_datasets.py

:)