C9Glax / tranga

Docker-Container to monitor (Manga) Scanlation-Sites for download new chapters.
GNU General Public License v3.0
138 stars 13 forks source link

[It broke]: mangaworld #103

Closed bubez81 closed 8 months ago

bubez81 commented 8 months ago

What is broken?

Hi, I can download manga from, for example manganato, but I can't from mangaworld.ac

Log-output

manganato:

[01/18/2024 08:59:05.6  ]     Manganato | Downloading image 001/012
[01/18/2024 08:59:05.6  ] HttpDownloadC | Waiting 0.9984885 seconds
[01/18/2024 08:59:07.437]     Manganato | /Manga/Saint Seiya Episode.g -Assassin-/Saint Seiya Episode.g -Assassin- - Ch.112 - The Brave Of Tomorrow.cbz 002/012 OK

mangaworld:

[01/18/2024 09:12:39.879]       JobBoss | Adding Job to Queue. Tranga.Jobs.DownloadNewChapters-b25lcHVuY2htYW4yMDEy Manga: Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:39.888]    Mangaworld | Getting new Chapters for Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:39.888]    Mangaworld | Getting chapters Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:40.138] HttpDownloadC | Request-Error NotFound: Not Found
[01/18/2024 09:12:40.138]    Mangaworld | Copy cover Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:40.143]    Mangaworld | Cover exists Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:40.143]       JobBoss | Added Tranga.Jobs.UpdateMetadata-b25lcHVuY2htYW4yMDEy Manga: Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:40.143]       JobBoss | Exporting Job /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-b25lcHVuY2htYW4yMDEy.json
[01/18/2024 09:12:40.145]       JobBoss | Adding Job to Queue. Tranga.Jobs.UpdateMetadata-b25lcHVuY2htYW4yMDEy Manga: Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:40.245]       JobBoss | Next job in 00:00:00 Tranga.Jobs.UpdateMetadata-b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:40.346] HttpDownloadC | Waiting 0.7923142 seconds
[01/18/2024 09:12:41.291] HttpDownloadC | Request-Error NotFound: Not Found
[01/18/2024 09:12:41.291] UpdateMetadat | Could not find Manga Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:41.392]       JobBoss | Removing Tranga.Jobs.UpdateMetadata-b25lcHVuY2htYW4yMDEy Manga: Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:41.392] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-b25lcHVuY2htYW4yMDEy Manga: Publication One Punch-Man b25lcHVuY2htYW4yMDEy
[01/18/2024 09:12:41.392]       JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-b25lcHVuY2htYW4yMDEy.json
[01/18/2024 09:12:41.393]       JobBoss | Next job in 00:24:50.4584990 Tranga.Jobs.DownloadNewChapters-anVqdXRzdWthaXNlbjIwMTg=

Additional stuff

No response

C9Glax commented 8 months ago

Hey there, can you pull the latest cuttingedge container and try again? In docker-compose.yaml change image to this.

services:
  tranga-api:
    image: glax/tranga-api:cuttingedge

I am trying to figure out what URL can not be found. So if you can post the logs again, that would be great. Thanks!

bubez81 commented 8 months ago

sure!

[01/20/2024 16:50:28.362]       JobBoss | Removing Tranga.Jobs.UpdateMetadata-dGhlYmVnaW5uaW5nYWZ0ZXJ0aGVlbmRzaWRlc3RvcnlqYXNtaW5ld2luZGJvcm5lMjAyMw== Manga: Publication The Beginning After the End: Side Story - Jasmine: Wind-Borne dGhlYmVnaW5uaW5nYWZ0ZXJ0aGVlbmRzaWRlc3RvcnlqYXNtaW5ld2luZGJvcm5lMjAyMw==
[01/20/2024 16:50:28.362] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-dGhlYmVnaW5uaW5nYWZ0ZXJ0aGVlbmRzaWRlc3RvcnlqYXNtaW5ld2luZGJvcm5lMjAyMw== Manga: Publication The Beginning After the End: Side Story - Jasmine: Wind-Borne dGhlYmVnaW5uaW5nYWZ0ZXJ0aGVlbmRzaWRlc3RvcnlqYXNtaW5ld2luZGJvcm5lMjAyMw==
[01/20/2024 16:50:28.362]       JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-dGhlYmVnaW5uaW5nYWZ0ZXJ0aGVlbmRzaWRlc3RvcnlqYXNtaW5ld2luZGJvcm5lMjAyMw==.json
[01/20/2024 16:50:28.364]       JobBoss | Next job in -00:00:00.0000001 Tranga.Jobs.UpdateMetadata-b3ZlcmdlYXJlZDIwMjA=
[01/20/2024 16:50:28.464] HttpDownloadC | Waiting 0.7970697 seconds
[01/20/2024 16:50:29.425] HttpDownloadC | Request-Error NotFound: https://www.mangaworld.bz/manga/
[01/20/2024 16:50:29.425] UpdateMetadat | Could not find Manga Publication Reincarnation of the Suicidal Battle God cmVpbmNhcm5hdGlvbm9mdGhlc3VpY2lkYWxiYXR0bGVnb2QyMDIx
[01/20/2024 16:50:29.525]       JobBoss | Removing Tranga.Jobs.UpdateMetadata-cmVpbmNhcm5hdGlvbm9mdGhlc3VpY2lkYWxiYXR0bGVnb2QyMDIx Manga: Publication Reincarnation of the Suicidal Battle God cmVpbmNhcm5hdGlvbm9mdGhlc3VpY2lkYWxiYXR0bGVnb2QyMDIx
[01/20/2024 16:50:29.525] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-cmVpbmNhcm5hdGlvbm9mdGhlc3VpY2lkYWxiYXR0bGVnb2QyMDIx Manga: Publication Reincarnation of the Suicidal Battle God cmVpbmNhcm5hdGlvbm9mdGhlc3VpY2lkYWxiYXR0bGVnb2QyMDIx
[01/20/2024 16:50:29.531]       JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-cmVpbmNhcm5hdGlvbm9mdGhlc3VpY2lkYWxiYXR0bGVnb2QyMDIx.json
[01/20/2024 16:50:29.532]       JobBoss | Next job in -00:00:00.0000001 Tranga.Jobs.UpdateMetadata-b3ZlcmdlYXJlZDIwMjA=
[01/20/2024 16:50:29.633] HttpDownloadC | Waiting 0.7921595 seconds
[01/20/2024 16:50:30.564] HttpDownloadC | Request-Error NotFound: https://www.mangaworld.bz/manga/
[01/20/2024 16:50:30.564] UpdateMetadat | Could not find Manga Publication Boku no Hero Academia Ym9rdW5vaGVyb2FjYWRlbWlhMjAxNA==
[01/20/2024 16:50:30.664]       JobBoss | Removing Tranga.Jobs.UpdateMetadata-Ym9rdW5vaGVyb2FjYWRlbWlhMjAxNA== Manga: Publication Boku no Hero Academia Ym9rdW5vaGVyb2FjYWRlbWlhMjAxNA==
[01/20/2024 16:50:30.664] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-Ym9rdW5vaGVyb2FjYWRlbWlhMjAxNA== Manga: Publication Boku no Hero Academia Ym9rdW5vaGVyb2FjYWRlbWlhMjAxNA==
[01/20/2024 16:50:30.664]       JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-Ym9rdW5vaGVyb2FjYWRlbWlhMjAxNA==.json
[01/20/2024 16:50:30.665]       JobBoss | Next job in -00:00:00.0000001 Tranga.Jobs.UpdateMetadata-b3ZlcmdlYXJlZDIwMjA=
[01/20/2024 16:50:30.766] HttpDownloadC | Waiting 0.7982884 seconds
[01/20/2024 16:50:31.721] HttpDownloadC | Request-Error NotFound: https://www.mangaworld.bz/manga/
[01/20/2024 16:50:31.721] UpdateMetadat | Could not find Manga Publication Overgeared b3ZlcmdlYXJlZDIwMjA=
[01/20/2024 16:50:31.821]       JobBoss | Removing Tranga.Jobs.UpdateMetadata-b3ZlcmdlYXJlZDIwMjA= Manga: Publication Overgeared b3ZlcmdlYXJlZDIwMjA=
[01/20/2024 16:50:31.821] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-b3ZlcmdlYXJlZDIwMjA= Manga: Publication Overgeared b3ZlcmdlYXJlZDIwMjA=
[01/20/2024 16:50:31.821]       JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-b3ZlcmdlYXJlZDIwMjA=.json
[01/20/2024 16:50:31.823]       JobBoss | Next job in 02:59:32.6416653 Tranga.Jobs.DownloadNewChapters-anVqdXRzdWthaXNlbjIwMTg=
C9Glax commented 8 months ago

Okay they just changed the top-level domain for their chapters. Should be working now if you can test cuttingedge again.

bubez81 commented 8 months ago

strange...nothings changed:

g=
[01/20/2024 17:31:07.157]       JobBoss | Adding Job to Queue. Tranga.Jobs.DownloadNewChapters-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:07.673]    Mangaworld | Getting new Chapters for Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:07.673]    Mangaworld | Getting chapters Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:07.847] HttpDownloadC | Request-Error NotFound: https://www.mangaworld.bz/manga/
[01/20/2024 17:31:07.847]    Mangaworld | Copy cover Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:08.700]    Mangaworld | Cover exists Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:08.700]       JobBoss | Added Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:08.700]       JobBoss | Exporting Job /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg=.json
[01/20/2024 17:31:08.701]       JobBoss | Adding Job to Queue. Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:08.802]       JobBoss | Next job in -00:00:00.0000002 Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:09.48 ] HttpDownloadC | Request-Error NotFound: https://www.mangaworld.bz/manga/
[01/20/2024 17:31:09.48 ] UpdateMetadat | Could not find Manga Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:09.148]       JobBoss | Removing Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:09.148] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg= Manga: Publication Jujutsu Kaisen anVqdXRzdWthaXNlbjIwMTg=
[01/20/2024 17:31:09.148]       JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-anVqdXRzdWthaXNlbjIwMTg=.json
[01/20/2024 17:31:09.149]       JobBoss | Next job in 02:59:59.6524582 Tranga.Jobs.DownloadNewChapters-anVqdXRzdWthaXNlbjIwMTg=
C9Glax commented 8 months ago

Ah sorry should have been clearer. Please remove all Mangaworld manga and re-add them.

bubez81 commented 8 months ago

ok, it seems to work, thanks!!! (with manga blue lock)

bubez81 commented 8 months ago

I think there are some problem with the search form with mangaworld, for example I can find: Fairy Tail: 100 Years Quest with Manganato but I can't in Mangaworld (fund 0 result in log) but: https://www.mangaworld.ac/archive?keyword=Fairy%20Tail:%20100%20Years%20Quest

bubez81 commented 8 months ago

ok, maybe it's a special character problem, I can't find this title either: Solo Max-Level Newbie but:

[01/25/2024 07:17:50.21 ]       JobBoss | Next job in -00:00:00.0000002 Tranga.Jobs.UpdateMetadata-am9qb3NiaXphcnJlYWR2ZW50dXJlcGFydHRoZWpvam9sYW5kczIwMjM=
[01/25/2024 07:17:50.281] HttpDownloadC | Waiting 0.9983661 seconds
[01/25/2024 07:17:51.774]    Mangaworld | Saving cover to /usr/share/tranga-api/imageCache/638417638702801820.jpg
[01/25/2024 07:21:46.853]    Mangaworld | Searching Publications. Term="Solo Max-Level Newbie"
[01/25/2024 07:21:47.222] HttpDownloadC | Waiting 0.9983068 seconds

and the cover doesn't appear

C9Glax commented 8 months ago

Ok for now you can always just paste the mangalink into the searchfield (with the connector selected).

bubez81 commented 8 months ago

Like this?

Screenshot 2024-01-25 alle 13 08 45

nothing happens

bubez81 commented 8 months ago

ok working with fairy tail but with solo max level seems to be impossible...strange...

and same problem with The Legendary Spearman Returns They don't work with either search or links

C9Glax commented 8 months ago

Can you try again, they are changing their top-level domain it seems, and I didn't reflect that beforehand.

bubez81 commented 8 months ago

do I have to delete the configuration again?

C9Glax commented 8 months ago

Anything that worked should keep working, so no.

bubez81 commented 8 months ago

nothing changed:

[01/27/2024 08:02:29.940]    Mangaworld | Searching Publications. Term="Solo Max-Level Newbie"
[01/27/2024 08:02:30.324] HttpDownloadC | Waiting 0.9924139 seconds

the strange thing is that it seems to go, from the logs....but the cover doesn't appear. It only happens with some titles, not with all. Entering the URL doesn't help, if I use the direct link nothing appears in the logs

one example is: https://www.mangaworld.ac/manga/2584/solo-max-level-newbie/ or: https://www.mangaworld.ac/manga/2905/damn-reincarnation/

other comics work perfectly

bubez81 commented 8 months ago

sorry but it's not solved, did you try with my two examples?

C9Glax commented 8 months ago

Don't know why I closed this....

C9Glax commented 8 months ago

Ah I can already see why... image plurals...

bubez81 commented 8 months ago

you are the best...solved!

bubez81 commented 8 months ago

Incredible, it seems that this manga is cursed:

[02/08/2024 09:43:50.207]       JobBoss | Adding Job to Queue. Tranga.Jobs.UpdateMetadata-c29sb21heGxldmVsbmV3YmllMjAyMQ== Manga: Publication Solo Max-Level Newbie c29sb21heGxldmVsbmV3YmllMjAyMQ==
[02/08/2024 09:43:50.308]       JobBoss | Next job in -00:00:00.0000001 Tranga.Jobs.UpdateMetadata-c29sb21heGxldmVsbmV3YmllMjAyMQ==
[02/08/2024 09:43:50.409] HttpDownloadC | Waiting 0.7902653 seconds
[02/08/2024 09:43:51.488] HttpDownloadC | Request-Error NotFound: https://www.mangaworld.ac/manga/
[02/08/2024 09:43:51.488] UpdateMetadat | Could not find Manga Publication Solo Max-Level Newbie c29sb21heGxldmVsbmV3YmllMjAyMQ==
[02/08/2024 09:43:51.589]       JobBoss | Removing Tranga.Jobs.UpdateMetadata-c29sb21heGxldmVsbmV3YmllMjAyMQ== Manga: Publication Solo Max-Level Newbie c29sb21heGxldmVsbmV3YmllMjAyMQ==
[02/08/2024 09:43:51.589] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-c29sb21heGxldmVsbmV3YmllMjAyMQ== Manga: Publication Solo Max-Level Newbie c29sb21heGxldmVsbmV3YmllMjAyMQ==
[02/08/2024 09:43:51.590]       JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-c29sb21heGxldmVsbmV3YmllMjAyMQ==.json
[02/08/2024 09:43:51.591]       JobBoss | Next job in 01:05:27.3120499 Tranga.Jobs.DownloadNewChapters-am9qb3NiaXphcnJlYWR2ZW50dXJlcGFydHRoZWpvam9sYW5kczIwMjM=

can't download it this is the direct url: https://www.mangaworld.ac/manga/2584/solo-max-level-newbie

C9Glax commented 8 months ago

Not so much cursed, as I am bad at Regex :) Should work now.

bubez81 commented 8 months ago
[02/08/2024 17:54:23.958] HttpDownloadC | Waiting 0.7876452 seconds
[02/08/2024 17:54:24.878] HttpDownloadC | Request-Error NotFound: https://www.mangaworld.ac/manga/
[02/08/2024 17:54:24.878] UpdateMetadat | Could not find Manga Publication Solo Max-Level Newbie c29sb21heGxldmVsbmV3YmllMjAyMQ==
[02/08/2024 17:54:24.978]       JobBoss | Removing Tranga.Jobs.UpdateMetadata-c29sb21heGxldmVsbmV3YmllMjAyMQ== Manga: Publication Solo Max-Level Newbie c29sb21heGxldmVsbmV3YmllMjAyMQ==
[02/08/2024 17:54:24.978] UpdateMetadat | Cancelling Tranga.Jobs.UpdateMetadata-c29sb21heGxldmVsbmV3YmllMjAyMQ== Manga: Publication Solo Max-Level Newbie c29sb21heGxldmVsbmV3YmllMjAyMQ==
[02/08/2024 17:54:24.978]       JobBoss | Deleting Job-file /usr/share/tranga-api/jobs/Tranga.Jobs.UpdateMetadata-c29sb21heGxldmVsbmV3YmllMjAyMQ==.json
[02/08/2024 17:54:24.980]       JobBoss | Next job in 02:55:06.6581281 Tranga.Jobs.DownloadNewChapters-am9qb3NiaXphcnJlYWR2ZW50dXJlcGFydHRoZWpvam9sYW5kczIwMjM=

It seems not, where am I wrong?

C9Glax commented 8 months ago

Have you removed the job and re-added it? The problem is that during the initial add it is parsing the id 2584/solo-max-level-newbie, or didnt because the regex was wrong.

bubez81 commented 8 months ago

Yes sure! Maybe I have to remove something manually?


Sorry...now it's working...

C9Glax commented 8 months ago

No worries 😃 I think this resolves everything in this issue? If so please close, thx