search

C9Glax / tranga

Docker-Container to monitor (Manga) Scanlation-Sites for download new chapters.
GNU General Public License v3.0
157 stars 15 forks source link

Request: add mangaworld.bz to sources list #50

Closed Hooteo closed 1 year ago

Hooteo commented 1 year ago

Hi, i'm trying this docker and it seems to be very good, do you think it's possible to add this source https://www.mangaworld.bz/ to download italian manga?

Thanks

C9Glax commented 1 year ago

Hey there! So far everyone has used english manga, however I have already some basic work done to also retrieve other languages (from Mangadex), so that shouldn't be too much work.

I will probably add support for different languages in the #41 release, which should be ready next week. As for the new connector, I will check after that release. When everything's ready I will @ you 👍🏼

C9Glax commented 1 year ago

@Hooteo if you want you can try the cuttingedge branch. It includes both the language select for mangadex as well as the new connector.

Feedback is appreciated!

Hooteo commented 1 year ago

I'm sorry i don't get it. How can i set the different language? I have update my docker compose but i don't have this possibility.

Thanks

C9Glax commented 1 year ago

Have you changed both tranga and website to cuttingedge? If so maybe clear your browser cache or hard refresh

Hooteo commented 1 year ago

This ismy docker-compose yaml:

version: '3' services: tranga-api: image: glax/tranga-api:latest container_name: tranga-api volumes:

I tried to update to the new version but i don't have any possoblity to change the language.

image

Only english:

image

C9Glax commented 1 year ago

image: glax/tranga-api:latest is your problem.

Use the cuttingedge branch version instead: https://github.com/C9Glax/tranga/blob/cuttingedge/docker-compose.yaml

You don't need imagecache anymore

Hooteo commented 1 year ago

@C9Glax it's working perfectly, i think you did a perfect job.

image

Only MangaDex can use different language?

Thanks

C9Glax commented 1 year ago

Thanks!

Mangadexx is the only site supporting multiple languages. Mangasee, Manganato, Mangakatana are all english only Mangaworld italian only.

Hooteo commented 1 year ago

@C9Glax ok now i found a problem with Mangaworld, some chapters needs the login to be downloaded (you pay a lifetime account to download everything) . Do you think it's possible to do the login and implement it in the settings?

MangaDex is the only one that support other languages but it has the problem to block your ip...

C9Glax commented 1 year ago

Hmm, I haven't done anything of that sort yet... So maybe at some point...

MangaDex only blocks your IP (as far as I know) if you exceed rate-limits, tranga doesn't do that, so that shouldn't be a problem

C9Glax commented 1 year ago

some chapters needs the login to be downloaded (you pay a lifetime account to download everything)

can you link to a chapter that would have that restriction, I can't seem to find any

Hooteo commented 1 year ago

Solo leveling need access, this is why you can't find it using tranga. I'm having the same problem with jujutsu kaisen https://www.mangaworld.bz/manga/1674/jujutsu-kaisen/read/5f9f965590f9bf1e6aeff067/1 if yout try to download it gave you an error because it needs a premium access. I have a premium account, if you can implement the login it would be perfect 👍

C9Glax commented 1 year ago

Is this what you are talking about? grafik

Because if so, there probably won't be a problem... I am scraping the webpage images, so if you can see the website with the chapter-images, you should be able to download it...

But if you say, that there was an error, could you maybe send the log-output? docker logs tranga-api

Hooteo commented 1 year ago

Manga web i have a lot of these errors:

2023/09/14 12:05:43 [error] 30#30: 10 open() "/usr/share/nginx/html/media/cover.jpg" failed (2: No such file or directory), client: 192.168.69.128, server: localhost, request: "GET /media/cover.jpg HTTP/1.1", host: "192.168.69.4:9555", referrer: "http://192.168.69.4:9555/" 192.168.69.128 - - [14/Sep/2023:12:05:43 +0000] "GET /media/cover.jpg HTTP/1.1" 404 555 "http://192.168.69.4:9555/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36 Edg/116.0.1938.76" "-" 192.168.69.128 - - [14/Sep/2023:12:05:44 +0000] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36 Edg/116.0.1938.76" "-" 2023/09/14 12:05:44 [error] 30#30: 10 open() "/usr/share/nginx/html/media/cover.jpg" failed (2: No such file or directory), client: 192.168.69.128, server: localhost, request: "GET /media/cover.jpg HTTP/1.1", host: "192.168.69.4:9555", referrer: "http://192.168.69.4:9555/" 192.168.69.128 - - [14/Sep/2023:12:05:44 +0000] "GET /media/cover.jpg HTTP/1.1" 404 555 "http://192.168.69.4:9555/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36 Edg/116.0.1938.76" "-" 192.168.69.128 - - [14/Sep/2023:12:38:11 +0000] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36 Edg/116.0.1938.76" "-" 192.168.69.128 - - [14/Sep/2023:12:38:11 +0000] "GET /media/cover.jpg HTTP/1.1" 404 555 "http://192.168.69.4:9555/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.0.0 Safari/537.36 Edg/116.0.1938.76" "-" 2023/09/14 12:38:11 [error] 30#30: *11 open() "/usr/share/nginx/html/media/cover.jpg" failed (2: No such file or directory), client: 192.168.69.128, server: localhost, request: "GET /media/cover.jpg HTTP/1.1", host: "192.168.69.4:9555", referrer: "http://192.168.69.4:9555/"

For manga api i don't have any logs:

image

image

When i try do download jujutsu kaisen it only downloaded Vol 24 Ch 01 all the other chapters are stuck:

image

C9Glax commented 1 year ago

Okay the first part doesn't matter, that's just a missing cover file that has been missing forever... Then again I am not the smartes tool in the shed, and I forgot to add the logger to tranga-api... Could you update docker compose pull && docker compose up -d for me, and then post the output of docker logs tranga-api again?

Hooteo commented 1 year ago

Yes now i have the logs: . So from what i notice it downloaded vol 24 chapter 02 and then it got stuck:

[09/14/2023 13:13:31.399] Mangaworld | Downloading image 019/026 [09/14/2023 13:13:32.480] Mangaworld | Downloading image 020/026 [09/14/2023 13:13:33.572] Mangaworld | Downloading image 021/026 [09/14/2023 13:13:34.676] Mangaworld | Downloading image 022/026 [09/14/2023 13:13:35.748] Mangaworld | Downloading image 023/026 [09/14/2023 13:13:36.859] Mangaworld | Downloading image 024/026 [09/14/2023 13:13:37.931] Mangaworld | Downloading image 025/026 [09/14/2023 13:13:39.16 ] Mangaworld | Downloading image 026/026 [09/14/2023 13:13:40.130] Mangaworld | Creating archive /Manga/Jujutsu Kaisen/Jujutsu Kaisen - Vol.24 Ch.02 .cbz [09/14/2023 13:13:41.37 ] JobBoss | Removing DownloadChapter Tranga.Jobs.DownloadChapter-anVqdXRzdWthaXNlbjIwMTg=-02 Chapter Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= 02 [09/14/2023 13:13:41.37 ] DownloadChapt | Cancelling DownloadChapter Tranga.Jobs.DownloadChapter-anVqdXRzdWthaXNlbjIwMTg=-02 Chapter Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= 02 [09/14/2023 13:13:41.38 ] JobBoss | Removing 0 jobs. [09/14/2023 13:13:41.38 ] JobBoss | Exporting Jobs [09/14/2023 13:13:41.149] Mangaworld | Retrieving chapter-info Chapter Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= 02 Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [09/14/2023 13:13:41.348] Mangaworld | Downloading Images for /Manga/Jujutsu Kaisen/Jujutsu Kaisen - Vol.24 Ch.02 .cbz

In fact no chapter is taken for download:

image

If i try to search solo leveling it doesn't show me anything:

image

Probably the problem is that the cover downloaded for solo leveling is in .png instead for the other manga is jpg:

Solo leveling logs:

[09/14/2023 13:18:48.974] Mangaworld | Searching Publications. Term="solo" [09/14/2023 13:18:51.769] Mangaworld | Saving cover to /var/lib/tranga-api/imageCache/5fab3399aadcf571527080e7.png

Jujutsu logs:

[09/14/2023 13:12:58.245] Mangaworld | Searching Publications. Term="jujutsu" [09/14/2023 13:13:00.943] Mangaworld | Saving cover to /var/lib/tranga-api/imageCache/5f9f94492041561e75ffff50.jpg [09/14/2023 13:13:03.200] Mangaworld | Saving cover to /var/lib/tranga-api/imageCache/5f9f989bf6abbe1e93b023d3.jpg

C9Glax commented 1 year ago

Sorry for getting back so late. Sidenote: If you can in the furture put logs in these blocks (it's 3 ` on both sides) that would increase readability.

[09/14/2023 13:13:41.348] Mangaworld | Downloading Images for /Manga/Jujutsu Kaisen/Jujutsu Kaisen - Vol.24 Ch.02 .cbz

Indicates that the task is started, but nothing happening probably means that an error occured, but wasn't logged. Also Vol.24 Ch.02 doesn't exist, but that should be an easy fix.

Probably the problem is that the cover downloaded for solo leveling is in .png instead for the other manga is jpg

Shouldn't really matter, but I will look into it.

C9Glax commented 1 year ago

Okay I just pushed to cuttingedge.

You couldn't find jujutsu kaisen, because i made a formatting mistake on titles with spaces, returning no results. Adding via url still worked fine, because that query was never made in that case.

HTML-Agilitypack apparently works in mysterious ways with xpath, because it doesn't care what node you execute xpath on, it always takes the documentElement as root, returning the same element, even if you were knee deep down the tree. In short: volume and chapter numbers were messed up, causing jobs to not work properly.

Hooteo commented 1 year ago

It sounds good. Now I'm on vacation for a week and I don't have access to my home lab. Once I'll be back I'll update you. Thanks

Hooteo commented 1 year ago

Hi @C9Glax i tried the new version and it's working fine. It's possible to schedule the check for new characters and download them automatically?

C9Glax commented 1 year ago

Copy & Paste from README:

This project downloads the images for a Manga from the specified Scanlation-Website and packages them with some metadata - from that same website - in a .cbz-archive (per chapter). It does this on an interval, and checks for any Chapters (.cbz-Archive) not already existing in your specified Download-Location. (If you rename or move files, it will download those again)

So it already does that.

Good to hear that it works though!

bubez81 commented 10 months ago

Hello, with mangaworld I receive this error: [01/18/2024 00:30:45.312] JobBoss | Exporting Job /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg=.json [01/18/2024 00:30:45.338] JobBoss | Adding Job to Queue. Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:45.542] HttpDownloadC | Request-Error NotFound: Not Found [01/18/2024 00:30:45.542] UpdateMetadat | Could not find Manga Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:45.643] JobBoss | Removing Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:45.643] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:45.643] JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg=.json [01/18/2024 00:30:45.644] JobBoss | Next job in 02:58:45.9378353 Tranga.Jobs.DownloadNewChapters-anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:51.345] JobBoss | Added Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:51.345] JobBoss | Exporting Job /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg=.json [01/18/2024 00:30:51.361] JobBoss | Adding Job to Queue. Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:51.559] HttpDownloadC | Request-Error NotFound: Not Found [01/18/2024 00:30:51.559] UpdateMetadat | Could not find Manga Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:51.659] JobBoss | Removing Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:51.659] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg= [01/18/2024 00:30:51.659] JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg=.json [01/18/2024 00:30:51.660] JobBoss | Next job in 02:58:39.9217308 Tranga.Jobs.DownloadNewChapters-anVqdXRzdWthaXNlbjIwMTg= did I do something wrong?