search

KJHJason / Cultured-Downloader

A project to automate the process of downloading images and other attachment files from platforms like Fantia and more!
GNU General Public License v3.0
69 stars 7 forks source link

[Bug]: (Kemono download speed extremely slow） #244

Closed onmymomma001 closed 3 months ago

onmymomma001 commented 3 months ago

Which program are you seeing this problem on?

Cultured Downloader (Go)

Program Version

Version 5.1.0

Operating System

Windows 10

What error code did you receive? (If any)

1007 (Download Error)

Steps to reproduce the bug

  1. When downloading from kemono posts scraping behavior and downloading is extremely slow

Expected behaviour

I had installed the program just fine not sure why I am getting download speeds that are 0.06MB/s and I was wondering if it was on my part as I had closed all other programs hogging network speed or is it some kind of DDOS protection on kemono's part. I had tried downloading from favorites as well as other creators any help would be appreciated!

Relevant log output (If any)

No response

Screenshots (Optional)

download speed

KJHJason commented 3 months ago

This is not a bug. Kemono's servers are the ones throttling the bandwidth. Hence, I can't do much about the download speed.

Even on my end, Kemono averages around 0.1-0.6MB/s which is really slow.

On the other hand, that's the main reason why I added the caching feature. It helps to avoid sending unnecessary requests to an already downloaded post to speed up the download process.

Thus, the more frequently you download from the SAME artist, the more posts the program caches and the faster your future download process gets.

KJHJason commented 3 months ago

However, I could probably increase the speed slightly by removing the unnecessary HEAD request to Kemono.