search

kevinzg / facebook-scraper

Scrape Facebook public pages without an API key
MIT License
2.37k stars 626 forks source link

Page auto redirected based on scrape location #941

Open wuperbear opened 1 year ago

wuperbear commented 1 year ago

Hi, loved your work and thanks for the effort.

I am having the problem of scraped pages automatically redirecting to my location while scraping page that has different country available.

To be specific: There are several fan pages for the game freefire based on Country, such as https://www.facebook.com/freefireTW/ https://www.facebook.com/FreeFireUSOfficial https://www.facebook.com/freefirepkofficial/ https://www.facebook.com/freefireIND https://www.facebook.com/freefirebr etc. All my scrape results were redirected to freefireTW because of my location...

by adding /?brand_redir=DISABLE I was able to access these pages without redirecting, but adding these behind the scrape bot parameter did not work.

I am guessing the bot scraped with mbasic.facebook because /?brand_redir=DISABLE worked with m.facebook.com but not mbasic? Just a guess

Any idea on how to solve this?

lgjluis commented 1 year ago

Maybe you can use a proxy for every account. The proxy must have an IP for the country you need.