kevinzg / facebook-scraper

Scrape Facebook public pages without an API key
MIT License
2.38k stars 628 forks source link

get_posts_by_search: No raw posts (elements) were found in this page. #1113

Open pitzmoni opened 1 day ago

pitzmoni commented 1 day ago

Hi!

This is happening since today. Any idea how to fix this?

Starting to iterate pages Requesting page from: https://m.facebook.com/search/posts?q=nintendo&filters=eyJyZWNlbnRfcG9zdHM6MCI6IntcIm5hbWVcIjpcInJlY2VudF9wb3N0c1wiLFwiYXJnc1wiOlwiXCJ9In0%3D Parsing page response No raw posts (elements) were found in this page. The page url is: https://www.facebook.com/search/posts?q=nintendo&filters=eyJyZWNlbnRfcG9zdHM6MCI6IntcIm5hbWVcIjpcInJlY2VudF9wb3N0c1wiLFwiYXJnc1wiOlwiXCJ9In0%3D&paipv=0&eav=AfYBYtYXxPsmSCoItP-NULyhOx13CGO6SHQiqtPSRrm2w5taUxlDlImty8q9s1gKi38&_rdr The page content is: +------------------------------------------------------------ | Facebook | :root, .fb-light-mode:root, .fb-light-mode {--fds-black:#000000;--fds-black-alpha-05:rgba(0, 0, 0, 0.05);--fds-black-alpha-10:rgba(0, 0, 0, 0.1);--fds-black-alpha-15:rgba(0, 0, 0, 0.15);--fds-black-alpha-20:rgba(0, 0, 0, 0.2);--fds-black-alpha-30:rgba(0, 0, 0, 0.3);--fds-black-alpha-40:rgba(0, 0, 0, 0.4);--fds-black-alpha-50:rgba(0, 0, 0, 0.5);--fds-black-alpha-60:rgba(0, 0, 0, 0.6);--fds-black-alpha-80:rgba(0, 0, 0, 0.8);--fds-blue-05:#ECF3FF;--fds-blue-30:#AAC9FF;--fds-blue-40:#77A7FF;--fds-blue-60:#1877F2;--fds-blue-

etc.

Got 0 raw posts from page Extracting posts from page 0 Looking for next page URL Page parser did not find next page URL

Many thanks!

ahmad-a-radwan07 commented 1 day ago

was it working for you yesterday?

mohit2jain commented 1 day ago

Facing same issue, was working for me yesterday. Please post here if you find any solution.

pitzmoni commented 7 hours ago

was it working for you yesterday?

The same worked well for a long time. I tried with different accounts, IPs, headers, nothing worked. I guess I will try to build something with selenium.

mohit2jain commented 7 hours ago

@pitzmoni looks like you tried moda20/facebook-scraper, its also not working?

pitzmoni commented 7 hours ago

@pitzmoni looks like you tried moda20/facebook-scraper, its also not working?

moda20 fork didn't work either even though using base_url, start_url, mbasicHeaders etc.

ahmad-a-radwan07 commented 6 hours ago

the reason it's not working anymore is that the generic facebook version that had the elements setup in the format supposedly tackled by the library is no longer showing, i used to get to that version by using an unsupported user agent, but it just shows unsupported browser message, if anybody can get a url format that would allow us to access that version of facebook the issue would be fixed