search

Komet / MediaElch

Media Manager for Kodi
https://mediaelch.github.io/mediaelch-doc/about.html
GNU Lesser General Public License v3.0
845 stars 94 forks source link

TMDB scraper fails to download posters #1796

Open meden opened 1 month ago

meden commented 1 month ago

Scrapers that don't work:

Details which are wrong / not loaded: Add a list of information that is not loaded correctly.

MediaElch Version:

Operating System:

Additional context: The automatic scraping of movies fails to download the poster from IMDB, with a "Not Found" error. Here the log of a failed operation:

MediaElch 2024-09-19 12:23:40.625 DEBUG : [MovieWidget] Changing movie to: "Apocalypse Now"
MediaElch 2024-09-19 12:23:40.790 DEBUG : [ImageCache] Using cache directory: DirectoryPath("/home/me/.local/share/kvibes/MediaElch/images")
MediaElch 2024-09-19 12:23:40.850 DEBUG : [MovieWidget] Opening: "Apocalypse Now"
MediaElch 2024-09-19 12:23:48.733 DEBUG : [MovieSearch] Open window
MediaElch 2024-09-19 12:23:48.734 DEBUG : [Movie Search] Changed scraper to: "TMDb"
MediaElch 2024-09-19 12:23:48.878 DEBUG : [Search Results] Count:  1
MediaElch 2024-09-19 12:23:52.177 DEBUG : Entered, message= "Scraping..." id= 20025
MediaElch 2024-09-19 12:23:52.674 DEBUG : [FanartTv] Load movie data with image types: "https://webservice.fanart.tv/v3/movies/28"
MediaElch 2024-09-19 12:23:52.860 DEBUG : [NotificationBox] Hide Progress bar with id 20025
MediaElch 2024-09-19 12:23:52.861 DEBUG : [NotificationBox] Removing message with ID: 20025
MediaElch 2024-09-19 12:23:52.861 DEBUG : Entered, msg= "Download immagini in corso..." id= 20025
MediaElch 2024-09-19 12:23:52.861 DEBUG : Entered, message= "Download immagini in corso..." id= 20025
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  0 | QUrl("http://image.tmdb.org/t/p/original/m2Y3Q0uyuW6htrn2W9UWCWMkpZu.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 0
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  1 | QUrl("http://image.tmdb.org/t/p/original/fuTEPMsBtV1zE98ujPONbKiYDc2.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 1
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  2 | QUrl("http://image.tmdb.org/t/p/original/ybMmK25h4IVtfE7qrnlVp47RQlh.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 2
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  3 | QUrl("http://image.tmdb.org/t/p/original/iwx7h0AfWMm9K4sMmhru3ShSra.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 3
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  4 | QUrl("http://image.tmdb.org/t/p/original/82ACmkTCHtKAuw42Jwx4JbjuVw0.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 4
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  5 | QUrl("http://image.tmdb.org/t/p/original/gxHgIe9swYgCcxSSCewQTF4J4VO.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 5
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  6 | QUrl("http://image.tmdb.org/t/p/original/jvcOpEO0vSNy3KaDkhIldI1CoaU.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  7 | QUrl("http://image.tmdb.org/t/p/original/n4dwIg6NbQzeMaS1yEKKlfNJH7a.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  8 | QUrl("http://image.tmdb.org/t/p/original/3Hg8mkb1RxqNhDOofzHdr0PoufH.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  9 | QUrl("http://image.tmdb.org/t/p/original/pWNa9H3ABB3Ug9CwTfVNtHsCFjV.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  10 | QUrl("http://image.tmdb.org/t/p/original/oDPuZvvA02xSjQQCiWEmIBmNTOv.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  11 | QUrl("http://image.tmdb.org/t/p/original/iMTQSdJ5R37IWC9ZRDIv06vvYMU.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  12 | QUrl("http://image.tmdb.org/t/p/original/ljxKA8lNf3HtMzDopBy2w7Zj0CM.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  13 | QUrl("http://image.tmdb.org/t/p/original/keBKcMPojtRTi5ImLXOoKDmDbqU.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  14 | QUrl("http://image.tmdb.org/t/p/original/hNAIkUVtsQfpC95BDkXr1lmoI2F.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  15 | QUrl("http://image.tmdb.org/t/p/original/qGOuDCsYQ6IVfUr2P5K2pV6v9Ij.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  16 | QUrl("http://image.tmdb.org/t/p/original/tttYalyq1zOMt8viYoAXoEMK8dF.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  17 | QUrl("http://image.tmdb.org/t/p/original/fXPJT1M0M4cAI0PH33de3XZi3es.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  18 | QUrl("http://image.tmdb.org/t/p/original/cFkUc4AUCdy82IpzPgMVeK3N1rc.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  19 | QUrl("http://image.tmdb.org/t/p/original/cKJ2ck7NfxY7KXS9jZInnluKMig.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  20 | QUrl("http://image.tmdb.org/t/p/original/7E0kD9z3lSXnAxNIC4ijnsAUsgf.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  21 | QUrl("http://image.tmdb.org/t/p/original/9wT4CU3lwKtXwbzlqtgIyRP2i7V.jpg")
MediaElch 2024-09-19 12:23:52.862 DEBUG : [DownloadManager] Enqueue download at pos  22 | QUrl("http://image.tmdb.org/t/p/original/zEy4ZnzuhhyueT5bef1jzQUFW7.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  23 | QUrl("http://image.tmdb.org/t/p/original/8HS85cCFOU0rytq2Qvswmmh5U5C.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  24 | QUrl("http://image.tmdb.org/t/p/original/jAvxYXAce0uKECsyT3f0mT8TNlC.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  25 | QUrl("http://image.tmdb.org/t/p/original/aXFJlEGHlQT7bwxkKwq6Sx7PeEp.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  26 | QUrl("http://image.tmdb.org/t/p/original/j42sFlGxqA3VaLNUcL5JyEiaeL2.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  27 | QUrl("http://image.tmdb.org/t/p/original/yRljsVWZwoTepSiUJOgPh2pN8d3.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  28 | QUrl("http://image.tmdb.org/t/p/original/8Ly1hRl39nrVzFLrHWbWrjgn8Jt.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  29 | QUrl("http://image.tmdb.org/t/p/original/5Ptl8apcuessOd2SpSYdt1lLcZl.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  30 | QUrl("http://image.tmdb.org/t/p/original/d0EhMvzu8l3DGoXej0CUddxeoWc.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  31 | QUrl("http://image.tmdb.org/t/p/original/l8dn7rKbjP36PtHsViHGpzf5ey7.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  32 | QUrl("http://image.tmdb.org/t/p/original/k91Dag8AZbhjIJqrtf7F1bQnGPg.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  33 | QUrl("https://assets.fanart.tv/fanart/movies/28/hdmovielogo/apocalypse-now-517879f3858f5.png")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  34 | QUrl("https://assets.fanart.tv/fanart/movies/28/moviebanner/apocalypse-now-59ef985684d15.jpg")
MediaElch 2024-09-19 12:23:52.863 DEBUG : [DownloadManager] Enqueue download at pos  35 | QUrl("https://assets.fanart.tv/fanart/movies/28/moviethumb/apocalypse-now-537fa8f8a362b.jpg")
MediaElch 2024-09-19 12:23:53.141 DEBUG : [DownloadManager] Start next download | Files left: 29 | Running: 5
MediaElch 2024-09-19 12:23:53.203 DEBUG : [DownloadManager] Start next download | Files left: 28 | Running: 5
MediaElch 2024-09-19 12:23:53.255 DEBUG : [DownloadManager] Start next download | Files left: 27 | Running: 5
MediaElch 2024-09-19 12:23:53.288 DEBUG : [DownloadManager] Start next download | Files left: 26 | Running: 5
MediaElch 2024-09-19 12:23:53.289 DEBUG : [DownloadManager] Start next download | Files left: 25 | Running: 5
MediaElch 2024-09-19 12:23:53.313 DEBUG : [DownloadManager] Start next download | Files left: 24 | Running: 5
MediaElch 2024-09-19 12:23:53.326 DEBUG : [DownloadManager] Start next download | Files left: 23 | Running: 5
MediaElch 2024-09-19 12:23:53.337 DEBUG : [DownloadManager] Start next download | Files left: 22 | Running: 5
MediaElch 2024-09-19 12:23:53.343 DEBUG : [DownloadManager] Start next download | Files left: 21 | Running: 5
MediaElch 2024-09-19 12:23:53.359 DEBUG : [DownloadManager] Start next download | Files left: 20 | Running: 5
MediaElch 2024-09-19 12:23:53.363 DEBUG : [DownloadManager] Start next download | Files left: 19 | Running: 5
MediaElch 2024-09-19 12:23:53.386 DEBUG : [DownloadManager] Start next download | Files left: 18 | Running: 5
MediaElch 2024-09-19 12:23:53.399 DEBUG : [DownloadManager] Start next download | Files left: 17 | Running: 5
MediaElch 2024-09-19 12:23:53.409 DEBUG : [DownloadManager] Start next download | Files left: 16 | Running: 5
MediaElch 2024-09-19 12:23:53.415 DEBUG : [DownloadManager] Start next download | Files left: 15 | Running: 5
MediaElch 2024-09-19 12:23:53.415 DEBUG : [DownloadManager] Start next download | Files left: 14 | Running: 5
MediaElch 2024-09-19 12:23:53.426 DEBUG : [DownloadManager] Start next download | Files left: 13 | Running: 5
MediaElch 2024-09-19 12:23:53.434 DEBUG : [DownloadManager] Start next download | Files left: 12 | Running: 5
MediaElch 2024-09-19 12:23:53.454 DEBUG : [DownloadManager] Start next download | Files left: 11 | Running: 5
MediaElch 2024-09-19 12:23:53.456 DEBUG : [DownloadManager] Start next download | Files left: 10 | Running: 5
MediaElch 2024-09-19 12:23:53.466 DEBUG : [DownloadManager] Start next download | Files left: 9 | Running: 5
MediaElch 2024-09-19 12:23:53.472 DEBUG : [DownloadManager] Start next download | Files left: 8 | Running: 5
MediaElch 2024-09-19 12:23:53.483 DEBUG : [DownloadManager] Start next download | Files left: 7 | Running: 5
MediaElch 2024-09-19 12:23:53.494 DEBUG : [DownloadManager] Start next download | Files left: 6 | Running: 5
MediaElch 2024-09-19 12:23:53.514 DEBUG : [DownloadManager] Start next download | Files left: 5 | Running: 5
MediaElch 2024-09-19 12:23:53.517 DEBUG : [DownloadManager] Start next download | Files left: 4 | Running: 5
MediaElch 2024-09-19 12:23:53.528 DEBUG : [DownloadManager] Start next download | Files left: 3 | Running: 5
MediaElch 2024-09-19 12:23:53.529 DEBUG : [DownloadManager] Start next download | Files left: 2 | Running: 5
MediaElch 2024-09-19 12:23:53.540 DEBUG : [DownloadManager] Start next download | Files left: 1 | Running: 5
MediaElch 2024-09-19 12:23:53.545 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 5
MediaElch 2024-09-19 12:23:53.567 WARN  : [DownloadManager] Network Error: "Error transferring http://image.tmdb.org/t/p/original/l8dn7rKbjP36PtHsViHGpzf5ey7.jpg - server replied: Not Found" | QUrl("http://image.tmdb.org/t/p/original/l8dn7rKbjP36PtHsViHGpzf5ey7.jpg")
MediaElch 2024-09-19 12:23:53.567 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 5
MediaElch 2024-09-19 12:23:53.571 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 4
MediaElch 2024-09-19 12:23:53.666 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 3
MediaElch 2024-09-19 12:23:54.369 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 2
MediaElch 2024-09-19 12:23:54.558 DEBUG : [DownloadManager] Start next download | Files left: 0 | Running: 1
MediaElch 2024-09-19 12:23:54.558 INFO  : [DownloadManager] All downloads finished
MediaElch 2024-09-19 12:23:54.989 DEBUG : [NotificationBox] Hide Progress bar with id 20025
MediaElch 2024-09-19 12:23:54.989 DEBUG : [NotificationBox] Removing message with ID: 20025

The poster remains non-clickable, with a spinner: image

After switching the movie, the missing image can be downloaded manually, by clicking on the poster: image

As you can see, the error is still present. It looks like the first four images (in this case) are missing, but choosing any other works. The same behavior appears with the majority (if not all) the movies in my collection.

bugwelle commented 1 month ago

Thanks for reporting!

It could be that failed image downloads are not handled well.

The movie seems to be "Apocalypse Now". What language do you use? :)

Regards, Andre

meden commented 1 month ago

It could be that failed image downloads are not handled well.

Very likely. The UI shows the error, but lets to select a picture anyway, so it is handled in some way. The "batch" scraper, on the other hand, fails on the error without recovery.

What language do you use?

I use Italian.

Thanks for your work :)

bugwelle commented 1 month ago

Thanks. I was not yet able to reproduce this error. Due to https://github.com/Komet/MediaElch/issues/1710 , I may not get to work on this in the near future, though.