Comments crawler not parsing pages correctly

rugantio / fbcrawl

A Facebook crawler

Apache License 2.0

668 stars 229 forks source link

Comments crawler not parsing pages correctly #72

Open erba994 opened 3 years ago

erba994 commented 3 years ago

Hi, I noticed that the comments crawler is always unable to parse comments from posts (specifically a single post from a group, when crawler is launched with the post attribute). The post page is parsed successfully but contains only the post itself without comments at all. Anyone knows what is happening?

erba994 commented 3 years ago

seems the issue is that when getting the post the page gets it without passing any cookie, as the user was unlogged, and comments do not show up. Still searching for a solution