search

Komet / MediaElch

Media Manager for Kodi
https://mediaelch.github.io/mediaelch-doc/about.html
GNU Lesser General Public License v3.0
813 stars 93 forks source link

I cannot scrape music Artists #1681

Open Santicoma opened 7 months ago

Santicoma commented 7 months ago

Scrapers that don't work:

Details which are wrong / not loaded: Add a list of information that is not loaded correctly. The scraper page open with the Artist Name, but after clicking It doesn't save any information, doesn't start

MediaElch Version:

Operating System:

Additional context: Until one month ago I used mediaElch to scrape music, but then I began to scrape Concerts and TV Shows, and left scrape music.

bugwelle commented 7 months ago

Hi,

thanks for reporting. Do you use the latest stable version or the latest nightly version? :)

I've fixed a few issues with the universal music scraper. I'll release a new version shortly.

Regards, Andre

bugwelle commented 7 months ago

v2.10.6 is released. Could you test it with the latest version? :)

Boulder08 commented 6 months ago

The same happens with 2.10.6. No matter what the scraper is, no results are displayed.

bugwelle commented 5 months ago

Hi,

I still can't reproduce the issue. Could you tell me:

  1. Which scraper is preferred in MediaElch's scraper settings? (i.e. the preferred scraper for the universal music scraper)
  2. Which checkboxes you select in the scrape dialog
  3. If you scrape a single artist or multiple ones
  4. For which artists this happens?

Regards, Andre

Boulder08 commented 5 months ago

1) I've tried all the scrapers there, same behaviour. The search field shows for a brief moment (like a fraction of a second) that it's searching, then no results. 2) I've tried all, and Name only. 3) No change, multiple artists seems to go through the selected ones like it does for a single artist, very short searching time for each. 4) For example Anathema, Black Sabbath.

To me it looks like the Universal Music Scraper itself is giving grief. Is there a way to debug what it actually does and gets as a result? I'd be happy to help you with that information.

bugwelle commented 5 months ago

Thank you. Are there at least search results in the scrape dialog?

Sorry about the issue. It's often easy to fix once I've reproduced the issue. But for me, searching works. I will have to test it on my Windows virtual machine... Do you use Windows 10 or 11 or another OS?

Screenshot_20240127_174614

Boulder08 commented 5 months ago

No, the dialog is completely empty which is why I suspected that it's due to the scraper itself.

image

I'm using Win10 with the latest updates.

bugwelle commented 5 months ago

Tested on Windows 10 with v2.10.6 and it works. hmm...

What language did you select for Universal Music Scraper in MediaElch's settings?

Also, could you provide a debug log if possible? You can enable it via an advancedsettings.xml file next to MediaElch.exe. See https://mediaelch.github.io/mediaelch-doc/settings.html#advanced-settings Copy this file and change <debug>false</debug> to <debug>true</debug>: https://github.com/Komet/MediaElch/blob/9f8892fb919fbb857b7696d2c16b356d416f379c/docs/advancedsettings.xml#L24-L32

Screenshot_20240128_123838

bugwelle commented 5 months ago

Also, maybe as a last resort: If you go and open https://musicbrainz.org/ws/2/artist/?query=artist:"Rainbow" , do you see anything? It should be an XML file (<metadata created…).

Boulder08 commented 5 months ago

With the help of the debug log, I was able to find out the reason! There was a network error and connection was just closed with any attempt. As I'd seen problems with various sites, I tested disabling my VPN connection and the search started working right away. There were also some connection issues with TMDb in the log but they disappeared when connecting without VPN.

Can you list the sites that are being connected with ME? I should put them all in the VPN bypass list to avoid any further issues.

bugwelle commented 5 months ago

Hi,

the list is:

http://image.tmdb.org/
http://www.fernsehserien.de/
https://api.discogs.com/
https://api.themoviedb.org/
https://api.thetvdb.com/
https://api.tvmaze.com
https://bilder.fernsehserien.de/
https://fanart.tv
https://image.tmdb.org/
https://m.media-amazon.com/
https://mediaelch.github.io/
https://musicbrainz.org/
https://raw.githubusercontent.com/
https://support.discogs.com/
https://theaudiodb.com/
https://thetvdb.com/
https://webservice.fanart.tv/
https://www.allmusic.com/
https://www.discogs.com/
https://www.fernsehserien.de/
https://www.hd-trailers.net
https://www.imdb.com/
https://www.musicbrainz.org/
https://www.televisiontunes.com/
https://www.theaudiodb.com/
https://www.themoviedb.org
https://www.thetvdb.com
https://www.tvmaze.com/
https://www.videobuster.de/
https://www.wikidata.org/
https://www.youtube.com/

If you use the adult scrapers, you need:

``` https://www.hotmovies.com https://aebn.net https://straight.theater.aebn.net https://gfx.videobuster.de/ https://www.adultdvdempire.com https://www.adultempire.com/ ```

(I did a quick grep for you and removed duplicates, etc.; not all may be required, but that's the list I have. :) )

Btw, thanks for telling me that it's due to the Network. The movie and TV show scraper already report network errors, but the music scraper does not...