search

docker / hub-feedback

Feedback and bug reports for the Docker Hub
https://hub.docker.com
235 stars 39 forks source link

Error response from daemon: toomanyrequests: Too Many Requests (HAP429) #2421

Open asntcrz opened 1 day ago

asntcrz commented 1 day ago

Hi,

Thank you for providing the support to every single case when this appears.

In my case it happened all of the sudden, without any changes on sysadmin so I have no idea how to determine if I have a loose script running wild with the requests, would you please be so kind to provide some stats, or possible causes? Project is hosted on VPS with IP 51.75.74.139.

I can't docker push anything, not even login or pull:

docker login -u ****
Password:
Error response from daemon: login attempt to https://registry-1.docker.io/v2/ failed with status: 429 Too Many Requests
docker pull nginx
Using default tag: latest
Error response from daemon: toomanyrequests: Too Many Requests (HAP429).

Thank you!

jcarter3 commented 1 day ago

What VPS provider are you using?

asntcrz commented 1 day ago

Its OVH (located in Frankfurt Germany)

aep-feha commented 1 day ago

I have the same issue with my OVH VPS as well, and it's in the same location, Frankfurt.

tobsen987 commented 1 day ago

Do you have IPv6 enabled on your VPS? I guess it has something to do with https://github.com/ubicloud/ubicloud/discussions/2244#discussioncomment-11232417.

asntcrz commented 1 day ago

ok disabling ipv6 in my host did the trick, followed these steps (https://webshanks.com/how-to-disable-ipv6-on-ubuntu/):

sudo nano /etc/sysctl.conf

Add at the end:

# Disable IPv6
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv6.conf.lo.disable_ipv6 = 1

And apply: sudo sysctl -p

But I'm not quite sure of the implications that this will have on our systems...

Ideally docker hub will fix the IPv6 rate limiter to take into account the whole 128 bits and not the first 64, blocking entire hosts, rather than individuals, right? as discussed here ubicloud/ubicloud/discussions/2244

jcarter3 commented 1 day ago

This is a delicate balance - rate limiting IPv6 is not straightforward, and we're trying to find the right path. We've seen many network setups where individual machines are granted a whole /64 space, with each individual network request coming from a different IP - this makes the system incredibly fragile to abuse.