How can we generate a problem set like the TREC problem set?

claritylab / lucida

Speech and Vision Based Intelligent Personal Assistant

Other

4.81k stars 881 forks source link

How can we generate a problem set like the TREC problem set? #218

Open zhhhhhh opened 6 years ago

zhhhhhh commented 6 years ago

I want to generate files like the TREC problem set to test the knowledge base, but I don't know how they were generated. The problems seem to be generated randomly, What tools do we need to use? Can you tell me? Thanks a lot.

Regards

KamalGalrani commented 6 years ago

TREC files aren’t generated randomly. They are generated on the basis of TREC guidelines and are available online.

If you want to make your own file, choose a TREC version supported by OpenEphyra, have a look at the format and manually create a matching file. Replace the TREC file with your own. Then ask OpenEphyra to run test with the TREC version -- Kamal Galrani IIT Bombay