KaiDMML / FakeNewsNet

This is a dataset for fake news detection research
1.07k stars 424 forks source link

How to resume downloading? And, only news content.json is downloading? #42

Closed shaanchandra closed 4 years ago

shaanchandra commented 4 years ago

Hi, Thank you for the repo. Really appreciate it!

I have been trying to download the entire dataset as per the instructions. When I run the main.py, it downloads only 432 fake and 624 real. Is that all the dataset that we have available now (everything else removed) ? It only downloads the news content.json though, even though in the config.json I have other things mentioned as well. Why is this happening? How can I obtain the engagement data?

Also, it just stops at that (I guess after downloading 7 of Gossipcop, so 432+624 +7). It has been 10 hours and it hasn't downloaded anything since then. I am guessing it is because of the limits imposed by Twitter API usage? But then when will it resume? Will it resume automatically? Or do I need to start it again (by running the 2 given commands)? If I do start it again, will it resume downloading the remaining or start all over again?