libertysoft3 / reddit-html-archiver

archive reddit data as offline friendly web pages
MIT License
169 stars 27 forks source link

getting Unable to connect to pushshift.io. Retrying after backoff #37

Open Goldmaster opened 1 year ago

Goldmaster commented 1 year ago

Hi there, I followed the guide though for setting up. However, when I try and download a subreddit, I get Unable to connect to pushshift.io. Retrying after backoff. warnings.warn("Unable to connect to pushshift.io. Retrying after backoff.") and the terminal just sits with nothing downloaded. The command ends with raise Exception("Unable to connect to pushshift.io. Max retries exceeded.") Exception: Unable to connect to pushshift.io. Max retries exceeded..

Is there a way to say download everything from a subreddit, into an HTML file friendly way? Just want to download posts, comments and media. Just have a html file that i can open in a web browser and browse.

EldonSamuelson commented 1 year ago

Probably related to Reddit kicking off Pushshift's API access

Unofficial PushShift Uptime Checker Pushshift Update from the Developer

Goldmaster commented 1 year ago

This was happening way beforehand.

I have given up and saved what I wanted to save using singlefile and boost and will now hope for the best.