search

JustAnotherArchivist / snscrape

A social networking service scraper in Python
GNU General Public License v3.0
4.48k stars 711 forks source link

Support for Parler #155

Open InnovativeInventor opened 4 years ago

InnovativeInventor commented 4 years ago

Parler is a young social media site that has "a significant user base of Trump supporters, conservatives, and Saudi nationalists. Posts on the website often contain far-right content, antisemitism, and conspiracy theories." (Source: Wikipedia).

For those reading this issue: this issue was filed after an IRC conversation on hackint#archivebot with JAA.

InnovativeInventor commented 3 years ago

I'm gonna close this issue now. Will reopen this issue if Parler goes back online.

martinratinaud commented 3 years ago

I need this too :-)

TheTechRobo commented 2 years ago

I'm going to see what I can do with making Parler work - it seems to have a pretty simple XHR schema.

TheTechRobo commented 2 years ago

Here are some notes for myself.

Getting User Feed (includes post contents :D) ``` import requests files = { 'user': (None, 'waynedupreeshow'), # 'page': (None, 2), } response = requests.post('https://parler.com/open-api/profile-feed.php', files=files).text print(response) ```

Technical problem: Parler seems to return only the first 20 posts in pagination; after that, it starts continually returning posts 11 to 20, it seems...

TheTechRobo commented 1 year ago

Looks like only individual posts can be retrieved without authentication now, cf. https://github.com/JustAnotherArchivist/snscrape/pull/399#issuecomment-1493510487

TheTechRobo commented 1 year ago

Looks like Parler is permanently offline. Back in April there was a death message, now all pages respond with 503.

Edit: This is apparently a "temporary measure," but it's been close to a month. I'm not sure it's coming back up. But it could.