brutalsavage / facebook-post-scraper

Facebook Post Scraper 🕵️🖱️
GNU General Public License v3.0
324 stars 116 forks source link

Comments return empty #15

Closed ManuelBanza closed 4 years ago

ManuelBanza commented 4 years ago

Hi @brutalsavage , I tried to download the comments from posts but it returns empty:

from scraper import extract
page = 'https://www.facebook.com/vodafonePT/'
comments = 'y'
list = extract(page, 30, comments)

and returns 'Comments': {} in every post. Did I miss something?

### UPDATE:

The comments field is returning data, however it only scrapes the most relevant comments. Any chance that it could scrap all coments instead @brutalsavage .

Thanks!

ManuelBanza commented 4 years ago

I came across this Expand All bookmark: http://com.hemiola.com/bookmarklet/ It works perfectly. Is it possible to incorporate that in the chromedriver before the scraping so it can scrape every single comment? Cheers!

brutalsavage commented 4 years ago

Yeah right now the comments are not working correctly. Unfortunetly I don't have time this summer do a lot of work on this repo. If you want, you can create a pull request implementing this and I'll take a look

gonhonoria commented 4 years ago

@ManuelBanza @brutalsavage i face the same issue... empty comments. How to deal with? Also is there a specific tag for posts with special mention(looking for recommendations)

rexshijaku commented 4 years ago

@ManuelBanza @gonhonoria is the account that you are using in English? if not can you try to change its language to English and try again? I found out that the issue which was causing problem to me was the language, since there was a bug in script. I made a pull request for the necessary changes that I think should be implemented. Hopefully this helps!

gonhonoria commented 4 years ago

Ooooh OK. I see then. For me the account is French. I will try your suggestion and let you know. Thanks for the feedback.

On Sat, Jul 18, 2020, 12:28 AM Rexhep Shijaku notifications@github.com wrote:

@ManuelBanza https://github.com/ManuelBanza @gonhonoria https://github.com/gonhonoria is the account that you are using in English? if not can you try to change its language to English and try again? I found out that the issue which was causing problem to me was the language, since there was a bug in script. I made a pull request for the necessary changes that I think should be implemented. Hopefully this helps!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/brutalsavage/facebook-post-scraper/issues/15#issuecomment-660379651, or unsubscribe https://github.com/notifications/unsubscribe-auth/AI27MODNM6W7I7XJIHWJCGTR4DNDPANCNFSM4NICMX5A .

husseinYY commented 4 years ago

We are waiting for the owner @brutalsavage to accept the pull request that was made by @rexshijaku

But if you know python you can certainly solve the problem yourself... Take a look at this

https://github.com/brutalsavage/facebook-post-scraper/pull/28/files

brutalsavage commented 4 years ago

Merged the pull request. Should fix the empty comment due to different language