Open MikeS159 opened 1 year ago
troyhunt
commented
1 year ago @stebet, have you observed this? I don't think we've had reports of bandwidth throttling before and I'm pretty sure that's not happening at Cloudflare.
Torrents are permanently gone, they became way too out of date as the monolithic downloads aren't being updated any more.
filimonic
commented
7 months ago Same here, it takes around 1 day to download ntlm database in 32 threads. Bandwidth drops from 60 Mbps to 3 Mbps. ISP does not limit anything
filimonic
commented
7 months ago IMO it will be better to make wider ranges supported by API, ex, making 4 chars instead of 5
GGG-KILLER
commented
5 months ago Don't have an entire day's ETA but I do have an entire hour's ETA:
I've compiled this locally using
dotnet publish -r linux-x64 -c Release -f net8.0 -o publish.
I have a 1 Gbps down 500 Mbps up connection and am not being limited by neither disk (NVMe), CPU nor network
Unsure if this is expected at all as there's no comment on download times anywhere.
Final result of the download:
Finished downloading all hash ranges in 3,873,525ms (270.70 hashes per second).
We made 1,048,576 Cloudflare requests (avg response time: 38.91ms). Of those, Cloudflare had already cached 1,048,576 requests, and made 0 requests to the Have I Been Pwned origin server.Took a total of 65 minutes and 26.3 seconds.
stebet
commented
5 months ago You can try with more threads using the -p switch, for example -p 64. That can help if you have plenty of bandwidth.
Possibly a Cloudflare limitation rather than the tool. It seems to be capping out at about 60Mb/s. Are torrent files still made available and if so could the tool provide a magnet link (or similar) to the most up to date torrent?