search

bocchilorenzo / ntscraper

Scrape from Twitter using Nitter instances
MIT License
180 stars 29 forks source link

Error fetching more than 100 tweets #53

Open molina180 opened 10 months ago

molina180 commented 10 months ago

If you can scrape more than 100 tweets, it only fetches 53 or 55. I think there's an issue with some instances.

Testing instances: 100%|███████████████████████████████████████████████████████████████████████| 30/30 [01:11<00:00, 2.38s/it] 09-Jan-24 18:13:59 - No instance specified, using random instance https://nitter.perennialte.ch 09-Jan-24 18:14:07 - Current stats for RTXSUPER: 6 tweets, 0 threads... 09-Jan-24 18:14:12 - Current stats for RTXSUPER: 8 tweets, 0 threads... 09-Jan-24 18:14:16 - Current stats for RTXSUPER: 12 tweets, 0 threads... 09-Jan-24 18:14:21 - Current stats for RTXSUPER: 16 tweets, 0 threads... 09-Jan-24 18:14:26 - Current stats for RTXSUPER: 24 tweets, 0 threads... 09-Jan-24 18:14:30 - Current stats for RTXSUPER: 30 tweets, 0 threads... 09-Jan-24 18:14:34 - Current stats for RTXSUPER: 36 tweets, 0 threads... 09-Jan-24 18:14:39 - Current stats for RTXSUPER: 38 tweets, 0 threads... 09-Jan-24 18:14:44 - Current stats for RTXSUPER: 43 tweets, 0 threads... 09-Jan-24 18:14:49 - Current stats for RTXSUPER: 48 tweets, 0 threads... 09-Jan-24 18:14:53 - Current stats for RTXSUPER: 49 tweets, 0 threads... 09-Jan-24 18:14:58 - Current stats for RTXSUPER: 50 tweets, 0 threads... 09-Jan-24 18:15:02 - Current stats for RTXSUPER: 51 tweets, 0 threads... 09-Jan-24 18:15:07 - Current stats for RTXSUPER: 51 tweets, 0 threads... 09-Jan-24 18:15:11 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:16 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:20 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:24 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:28 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:32 - Current stats for RTXSUPER: 53 tweets, 0 threads... 09-Jan-24 18:15:36 - Current stats for RTXSUPER: 54 tweets, 0 threads... 09-Jan-24 18:15:41 - Current stats for RTXSUPER: 54 tweets, 0 threads... 09-Jan-24 18:15:45 - Current stats for RTXSUPER: 54 tweets, 0 threads... 09-Jan-24 18:15:48 - Empty page on https://nitter.perennialte.ch

AritzUMA commented 10 months ago

Tru with another instance, but if there are not more tweets for this term, in the selected date and in the selected instance, you don't gonna get more.

GinaMhd commented 4 months ago

I have the same problem and get Empty page on... exactly after 55 tweets, Did you find a solution for this?