search

MOHOAzure / FB-auto-reporter

A fb page bot automatically collects news and makes reports
2 stars 0 forks source link

automatically collect posts of FB group and fan pages #3

Closed MOHOAzure closed 3 years ago

MOHOAzure commented 3 years ago

network request/post analysis https://tlyu0419.github.io/2020/03/17/Crawl-Facebook-Pages/ https://github.com/TLYu0419/TLYu0419.github.io/issues/15

MOHOAzure commented 3 years ago

by a specific post id and mobile mode

https://www.youtube.com/watch?v=ZImNusQ0I6g

MOHOAzure commented 3 years ago

Tool: https://www.scrapestorm.com https://www.youtube.com/watch?v=IGL2vgGBVDU

MOHOAzure commented 3 years ago

Scrape Facebook public pages without an API key https://github.com/kevinzg/facebook-scraper https://pypi.org/project/facebook-scraper/

MOHOAzure commented 3 years ago

facebook-scraper works well.

check example output csv file for useful columns, which are attributes of 'posts' objects.

For now, post_id, text, and time may be useful.

Group format: https://www.facebook.com/groups/{Club-ID}/permalink/{Post-ID}

If post_id is None, it is a shared post, and it may has a 'post_url'.