Retrieve next page only if it exists

bisguzar / twitter-scraper

Scrape the Twitter Frontend API without authentication.

MIT License

3.91k stars 599 forks source link

Open ocheja opened 4 years ago

ocheja commented 4 years ago

Fixes the problem of crawling only 2~5 pages even when more pages are requested.

bisguzar commented 4 years ago

Hi Patrick, First at all thanks for you contribution. Can you create an example scenario about the problem?