Support for Gab - Githubissues

JustAnotherArchivist / snscrape

A social networking service scraper in Python

GNU General Public License v3.0

4.48k stars 711 forks source link

Support for Gab #184

Open Arf9999 opened 3 years ago

Arf9999 commented 3 years ago

Seems that timelines (without comments) and hot posts/popular posts are available without auth.

JustAnotherArchivist commented 3 years ago

There was a module for Gab before they moved to Mastodon. Now, maybe a general Mastodon module (#43) will work, but Gab's instance is modified quite heavily, so leaving this open for the time being.

JustAnotherArchivist commented 3 years ago

I looked into this a bit. A generic Mastodon scraper will not work because Gab is so heavily modified. Also, only very little content is accessible without logging in: 10 most recent posts or reposts on profiles, 15-ish (variable) posts on the hot and top feeds. All pagination is blocked as far as I can tell. Seems like a lot of effort for that...