search

KaiDMML / FakeNewsNet

This is a dataset for fake news detection research
1.11k stars 432 forks source link

Download Interruption #59

Open ChrisBobotsis opened 3 years ago

ChrisBobotsis commented 3 years ago

Hi,

If my download is interrupted, does the download have to be started from the beginning again or will it resume from where it left off?

ChrisBobotsis commented 3 years ago

From my understanding, if I just remove the data-points that I have already downloaded from the CSV files I should just download the remainder.

SouzaCadu commented 2 years ago

I have been facing the same issue. I've already checked my API credentials, running 10 sample data points for each category, and it has worked well. It takes a little while to download the entire news data; however, I can't complete the Twitter download for the whole dataset. After starting the processing of the Twitter data, I received the ERROR 429 (Too Many Requests). The TWitter recommends pausing the requests; however, there aren't instructions about how to break the process and resume where it left off later.