search

GAIR-NLP / factool

FacTool: Factuality Detection in Generative AI
https://ethanc111.github.io/factool_website/
Apache License 2.0
804 stars 62 forks source link

Where to download FactPrompts dataset? #38

Closed zhimin-z closed 9 months ago

zhimin-z commented 9 months ago

I cannot find any related sources...

steffichern commented 9 months ago

Hi! Thank you for your interests in our work! The datasets can be found here: https://github.com/GAIR-NLP/factool/tree/main/datasets

Let us know if you have more questions!

zhimin-z commented 9 months ago

Hi! Thank you for your interests in our work! The datasets can be found here: https://github.com/GAIR-NLP/factool/tree/main/datasets

Let us know if you have more questions!

Thanks! Are all of five folders fastprompt? image

void-b583x2-NULL commented 9 months ago

It appears to be that in the knowledge_qa folder are the 50 lines of FactPrompts. However, I also wonder that where the RoSE dataset locates. Is the dataset dynamically generated by the original QAGS repo? Thx.

steffichern commented 9 months ago

Hi, you can find the RoSE dataset here: https://huggingface.co/datasets/Salesforce/rose

Also, only the KBQA and scientific prompts are from FactPrompts. The code prompts are from HumanEval, and the math prompts are from GSMHard.

qishenghu commented 1 month ago

Hi, you can find the RoSE dataset here: https://huggingface.co/datasets/Salesforce/rose

Also, only the KBQA and scientific prompts are from FactPrompts. The code prompts are from HumanEval, and the math prompts are from GSMHard.

image

Hi, may i know which split is the 100 RoSE data used in the paper?