search

Wulfre / e621dl

An automated download script for e621.net.
19 stars 8 forks source link

Abruptly (as of 5/26/21) getting 403 errors immediately on launch #47

Closed grug-son-of-thog closed 3 years ago

grug-son-of-thog commented 3 years ago

I've been happily using this program for a few years now to keep my library up to date, but recently it has ceased to function without any change to my config.yaml. Specifically, I'm getting the following:

[i] Running e621dl version 5.0.0. [i] Getting config... [i] Getting posts for search 'ardan_norgate'. Traceback (most recent call last): File ".\e621dl.py", line 42, in <module> posts = remote.get_posts(client, ' '.join(search['tags']), search['start_date'], last_id) File "D:\Downloaders\E621DL\e621dl\remote.py", line 12, in get_posts response.raise_for_status() File "C:\Users\Mark\AppData\Local\Programs\Python\Python38-32\lib\site-packages\httpx\_models.py", line 841, in raise_for_status raise HTTPError(message, response=self) httpx._exceptions.HTTPError: 403 Client Error: Forbidden for url: https://e621.net/posts.json?limit=320&tags=ardan_norgate+date%3A%3E%3D1994-01-10+ For more information check: https://httpstatuses.com/403

I'm not entirely sure what's causing this 403. I'm not [currently] behind a VPN, I don't believe my account is banned (I'm able to browse normally), etc. I'm able to manually access the URL in question (https://e621.net/posts.json?limit=320&tags=ardan_norgate+date%3A%3E%3D1994-01-10+) and see the expected JSON, but running the script results in an immediate failure.

RedFoxNightfox commented 3 years ago

Due to Cloudflare's DDOS protection, all queries must first pass a captcha.

This blocks all external JSON API calls, which causes the 403 error.

There is nothing wrong with the script, and nothing anyone can do until the DDOS mitigations are over, and the site returns to normal operation.

From the E621 official Discord server:

We're still experiencing a sizable DDoS and as such captchas are enforced on all endpoints, including the API. Please sit tight while we wait for our devs to work on it.

Current best ETA: Soon™️

grug-son-of-thog commented 3 years ago

Ahhhh, okay. I was unaware there were DDOS issues right now. That makes total sense. Thanks!