search

minimaxir / facebook-page-post-scraper

Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Analysis
2.12k stars 662 forks source link

Getting *all* posts from a page. #39

Closed TransGirlCodes closed 7 years ago

TransGirlCodes commented 7 years ago

I'm doing a project analysing data and ideally I want to collect all posts from a Facebook page. But I know the FB graph API has a limit of 100. I was wondering whether using pagination as in the get_fb_posts_fb_page.py file either: (1) Ensures all posts going back in time get collected. Or (2) Navigates through different pages and gets only the first 100 posts from each page.

minimaxir commented 7 years ago

The scraper goes as far back as possible until it can't go any further.