search

webrecorder / browsertrix-behaviors

Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.
GNU Affero General Public License v3.0
34 stars 18 forks source link

Facebook-comments - crawling broken on some type of "pages" since end september #25

Open Klindten opened 2 years ago

Klindten commented 2 years ago

When logged in Facebook I get a popup when choosing to see comments (not on all Facebook-pages but on some - see below). This new behaviour is not supported in archiveweb.page and the AutoPilot-function doens´t work. Earlier the comments just expanded downwards - thus being crawled fine with AutoPilot in many cases. I checked with co-workers and they didn´t have the same experience in Facebook.

Expanding: https://www.facebook.com/events/605424690504682/?active_tab=discussion (Events )

Popup: https://www.facebook.com/thecure (Posts) https://www.facebook.com/groups/266964407286603 (Groups)

edsu commented 2 years ago

@Klindten can you create a short video of the popup behavior you are seeing? When I click on those links (logged in and not logged in) I don't see any?

Klindten commented 2 years ago

https://watch.screencastify.com/v/kvy9xR7AUrePlRfxVyJf Maybe a partly roll-out?

edsu commented 2 years ago

I see it now, thanks! I'm going to move this over to the browsertrix-behaviors repository since it will likely involve updates there.