search

manga-download / hakuneko

Manga & Anime Downloader for Linux, Windows & MacOS
https://hakuneko.download
The Unlicense
4.69k stars 470 forks source link

[idk what to call it] why are useless connectors still in the connectors list #1989

Closed Robonau closed 4 years ago

Robonau commented 4 years ago

a Connector that you cant get a list of manga from is useless like "line webtoon" if you cant get a list of manga from it, and arent willing to support old list when they get a bit broke #1635, #1861, and, #1988 then why do they still show up in the connectors list?

ronny1982 commented 4 years ago

Users will complain when there is no manga list, users will complain when it takes hours to synchronize a manga list... This is status quo. For LINE it took like 2~3 hours on the old 1 GBit CDN to do a nightly sync, therefore it would take much longer for users.

Th websites are not removed, because copy & paste still allows bookmarking and downloading.

There was a suggestion that users may share their downloaded lists, but from similar experience i doubt this will work out, it will probably become an outdated collection of manga lists.

Sheepux commented 4 years ago

What was the main issue with the CDN scripts ?

Robonau commented 4 years ago

if the CDN is no longer a thing then why not give users some way to update sites currently like "line webtoon" as well as any future connectors that go the same way

Robonau commented 4 years ago

maybe something that could just run on a raspberry pi continuously, given the main bottle neck seems to be the limited requests/s from the sites

Sheepux commented 4 years ago

I can host such scripts within my kubernetes cluster (with node autoscaling), it would be transparent for me. That's why i'm asking what is the main issue with the CDN scripts (is it maintenance issue or something else?)

ronny1982 commented 4 years ago

Scripts are breaking, cannot solve captchas, needs to be updated frequently when website changes, ASN got blacklisted by some websites, ...

ronny1982 commented 4 years ago

If someone wanna check it, just clone https://github.com/manga-download/hakuneko-cdn and run npm install followed by e.g. npm run linewebtoon-en It will update the manga list in the corresponding folder of the local repository

Robonau commented 4 years ago

i made an ahk script that does it (i don't know js, like at all) (linewebtoon-en) linewebtoon connector attempt.zip it takes a few hours to run, but it should output a functioning list (i have run it to completion)(there are some duplicates in the end,not that that causes any issues)