shaikhsajid1111 / facebook_page_scraper

Scrapes facebook's pages front end with no limitations & provides a feature to turn data into structured JSON or CSV
https://pypi.org/project/facebook-page-scraper/
MIT License
230 stars 65 forks source link

all_posts length: 0 until timeout #119

Closed sunray1 closed 4 hours ago

sunray1 commented 5 hours ago

I'm having troubles scraping a group page. I haven't dug too much into the code yet but essentially while the scraper is running, it just continually write "all_posts length: 0" until timeout. It seems to do this just for groups, for pages the issue is still the same as #115. See below.

>>> meta_ai = Facebook_scraper('bug.identification', 1, isGroup=True) >>> json_data = meta_ai.scrap_to_json() new layout loaded all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0 all_posts length: 0

sunray1 commented 4 hours ago

Ah - this is because I was expecting this group - 'https://www.facebook.com/groups/bug.identification', where the code goes to 'https://www.facebook.com/bug.identification' which is a page.

Had to change to the actual ID number to get it working. Errors are same as #115 now.