too many empty folders when downloading news articles

[panicpan2000]

I am trying to get the Twitter API key. So I only collect the news first. I ran the code and set data_features_to_collect = ["news_articles"], but I encountered trouble. It seems that many URLs have been invalid and create empty folders without news content.json. Is there any other alternative method to obtain the dataset?

[panicpan2000]

Using a proxy can solve part of the problem. However, some news actually no longer exists.

[rasel3413]

are you able to download the full dataset??can you please share it with me..? i am having so much trouble ...it taking so much time