rembo10 / headphones

Automatic music downloader for SABnzbd
GNU General Public License v3.0
3.4k stars 600 forks source link

Fails to find albums for an artist. #454

Closed MaienM closed 12 years ago

MaienM commented 12 years ago

I just added the artist Guns N' Roses to HeadPhones. It found the artist, proceeded to fetch albums... and came up empty. I've check with musicbrainz, and it does indeed have albums listed for this artist: http://musicbrainz.org/artist/eeb1195b-f213-4ce1-b28c-8565211f8e43. What's going wrong here? The logs lists this: WARNING Attempt to retrieve artist information from MusicBrainz failed for artistid: eeb1195b-f213-4ce1-b28c-8565211f8e43. Sleeping 5 seconds. There are a couple of errors WARNING Attempt to retrieve information from MusicBrainz for release group "617c9f00-9488-3a70-a994-9de312541617" failed. Sleeping 5 seconds and the like, but Guns n' Roses is the only one that seems to fail at artist information.

jdoggvt commented 12 years ago

I have the same problem. I started from scratch (windows exe, 7c314a282cd8644dba14280032bc0466c0a87395) and none of my artists have 'official' albums populated. Looking at the logs I get a ton of errors like this:

2012-01-25 10:41:12 WARNING Attempt to retrieve information from MusicBrainz for release group "e167e229-0a07-3550-abb9-4ee0ae84db19" failed. Sleeping 5 seconds 2012-01-25 10:40:58 WARNING Attempt to retrieve information from MusicBrainz for release group "e167e229-0a07-3550-abb9-4ee0ae84db19" failed. Sleeping 5 seconds 2012-01-25 10:40:57 INFO Unable to get release information for [Album Name] - there may not be any official releases in this release group

KenzoB73 commented 12 years ago

Same here, just tried to add Muse.

2012-01-25 11:00:24 WARNING Attempt to retrieve information from MusicBrainz for release group "6f151223-f3a3-3e57-810f-598f7897006c" failed. Sleeping 5 seconds

2012-01-25 10:59:42 WARNING Attempt to query MusicBrainz for muse failed: HTTP Error 503:

jdoggvt commented 12 years ago

Yep, I'm getting the 503 errors now too:

2012-01-25 11:40:12 WARNING Attempt to query MusicBrainz for Barber failed: HTTP Error 503: 2012-01-25 11:40:07 WARNING Attempt to query MusicBrainz for Barber failed: HTTP Error 503: 2012-01-25 11:40:01 WARNING Attempt to query MusicBrainz for Barber failed: HTTP Error 503: 2012-01-25 11:39:56 WARNING Attempt to query MusicBrainz for Barber failed: HTTP Error 503: 2012-01-25 11:39:51 WARNING Attempt to query MusicBrainz for Barber failed: HTTP Error 503: 2012-01-25 11:39:50 INFO Ozzy Osbourne is already in the database. Updating 'have tracks', but not artist information

MaienM commented 12 years ago

That makes sense, considering what 503 means: 503 Service Unavailable The server is currently unavailable (because it is overloaded or down for maintenance).[2] Generally, this is a temporary state. (from https://secure.wikimedia.org/wikipedia/en/wiki/List_of_HTTP_status_codes) So that 503 error is probably not related to HeadPhones at all.

rembo10 commented 12 years ago

This is gonna happen for the next few days until more people update to the latest version

On Jan 25, 2012, at 2:47 PM, Michon van Doorenreply@reply.github.com wrote:

I just added the artist Guns N' Roses to HeadPhones. It found the artist, proceeded to fetch albums... and came up empty. I've check with musicbrainz, and it does indeed have albums listed for this artist: http://musicbrainz.org/artist/eeb1195b-f213-4ce1-b28c-8565211f8e43. What's going wrong here? The logs lists this: WARNING Attempt to retrieve artist information from MusicBrainz failed for artistid: eeb1195b-f213-4ce1-b28c-8565211f8e43. Sleeping 5 seconds. There are a couple of errors WARNING Attempt to retrieve information from MusicBrainz for release group "617c9f00-9488-3a70-a994-9de312541617" failed. Sleeping 5 seconds and the like, but Guns n' Roses is the only one that seems to fail at artist information.


Reply to this email directly or view it on GitHub: https://github.com/rembo10/headphones/issues/454

MaienM commented 12 years ago

So it'll resolve itself in a few days? Fine by me, I'm not in a hurry :)

jdoggvt commented 12 years ago

still no dice getting it to scrape albums, everything comes up empty with lots of:

2012-01-27 09:50:00 WARNING Attempt to retrieve information from MusicBrainz for release group "6a44f03b-e1b1-359e-9c3e-3b7821b4e186" failed. Sleeping 5 seconds 2012-01-27 09:49:54 WARNING Attempt to retrieve information from MusicBrainz for release group "6a44f03b-e1b1-359e-9c3e-3b7821b4e186" failed. Sleeping 5 seconds 2012-01-27 09:49:49 WARNING Attempt to retrieve information from MusicBrainz for release group "6a44f03b-e1b1-359e-9c3e-3b7821b4e186" failed. Sleeping 5 seconds 2012-01-27 09:49:44 WARNING Attempt to retrieve information from MusicBrainz for release group "6a44f03b-e1b1-359e-9c3e-3b7821b4e186" failed. Sleeping 5 seconds

Is this still a result of too many people using older versions or is there some other log I can provide?

rembo10 commented 12 years ago

Still too many people on the old version. The traffic is slowly but surely coming down. If it's not fixed by Monday i'll ask musicbrainz to block requests from the old user agent

farfromrefug commented 12 years ago

2012-01-30 17:05:29 INFO Unable to get release information for The Guitar and Other Machines - there may not be any official releases in this release group 2012-01-30 17:05:22 WARNING Attempt to retrieve information from MusicBrainz for release group "95b47e04-2b60-3ff1-a8d8-9b791e0e73e0" failed. Sleeping 5 seconds

But the album is on MusicBrainz http://musicbrainz.org/release-group/95b47e04-2b60-3ff1-a8d8-9b791e0e73e0

I am not sure if it is the same problem.

Thanks

lechat commented 12 years ago

From Musicbrainz Wiki (http://wiki.musicbrainz.org/XML_Web_Service/Rate_Limiting):

User-Agent For user-agents "python-musicbrainz/0.7.3" and "python-headphones/0.7.3": we allow through (on average) 50 requests per second, and decline (http 503) the rest.

So if many people update their artists at the same time - all using the user-agent - some requests will be throttled and receive 503 in return.

Jivebunny commented 12 years ago

Still the same issue (http://musicbrainz.org/artist/9c9f1380-2516-4fc9-a3e6-f9f61941d090) Headphones version: 514844ec2dfa81e68129e0e9e9bfcc7cdcf18fff):

Timestamp Level Message 2012-01-31 13:27:01 WARNING Attempt to retrieve information from MusicBrainz for release group "6f151223-f3a3-3e57-810f-598f7897006c" failed. Sleeping 5 seconds 2012-01-31 13:26:56 WARNING Attempt to retrieve information from MusicBrainz for release group "6f151223-f3a3-3e57-810f-598f7897006c" failed. Sleeping 5 seconds 2012-01-31 13:26:55 INFO Unable to get release information for Origin of Symmetry - there may not be any official releases in this release group 2012-01-31 13:26:47 WARNING Attempt to retrieve information from MusicBrainz for release group "ef03fe86-b54c-3667-8768-029833e7e1cd" failed. Sleeping 5 seconds 2012-01-31 13:26:41 WARNING Attempt to retrieve information from MusicBrainz for release group "ef03fe86-b54c-3667-8768-029833e7e1cd" failed. Sleeping 5 seconds 2012-01-31 13:26:41 INFO Unable to get release information for Showbiz - there may not be any official releases in this release group 2012-01-31 13:26:32 WARNING Attempt to retrieve information from MusicBrainz for release group "a842d860-a023-3a71-ad2e-a3a94cffabd7" failed. Sleeping 5 seconds 2012-01-31 13:26:26 WARNING Attempt to retrieve information from MusicBrainz for release group "a842d860-a023-3a71-ad2e-a3a94cffabd7" failed. Sleeping 5 seconds 2012-01-31 13:26:26 INFO Now adding/updating: Muse 2012-01-31 13:25:57 WARNING Attempt to query MusicBrainz for Muse failed: HTTP Error 503: 2012-01-31 13:25:56 INFO Now adding/updating: Muse

rembo10 commented 12 years ago

Yeah, i'm going to hurry up on the mb sync update, its just requiring a lot of code to be changed

On Jan 31, 2012, at 12:27 PM, Tim Hueskenreply@reply.github.com wrote:

Still the same issue:

Timestamp Level Message 2012-01-31 13:27:01 WARNING Attempt to retrieve information from MusicBrainz for release group "6f151223-f3a3-3e57-810f-598f7897006c" failed. Sleeping 5 seconds 2012-01-31 13:26:56 WARNING Attempt to retrieve information from MusicBrainz for release group "6f151223-f3a3-3e57-810f-598f7897006c" failed. Sleeping 5 seconds 2012-01-31 13:26:55 INFO Unable to get release information for Origin of Symmetry - there may not be any official releases in this release group 2012-01-31 13:26:47 WARNING Attempt to retrieve information from MusicBrainz for release group "ef03fe86-b54c-3667-8768-029833e7e1cd" failed. Sleeping 5 seconds 2012-01-31 13:26:41 WARNING Attempt to retrieve information from MusicBrainz for release group "ef03fe86-b54c-3667-8768-029833e7e1cd" failed. Sleeping 5 seconds 2012-01-31 13:26:41 INFO Unable to get release information for Showbiz - there may not be any official releases in this release group 2012-01-31 13:26:32 WARNING Attempt to retrieve information from MusicBrainz for release group "a842d860-a023-3a71-ad2e-a3a94cffabd7" failed. Sleeping 5 seconds 2012-01-31 13:26:26 WARNING Attempt to retrieve information from MusicBrainz for release group "a842d860-a023-3a71-ad2e-a3a94cffabd7" failed. Sleeping 5 seconds 2012-01-31 13:26:26 INFO Now adding/updating: Muse 2012-01-31 13:26:25 INFO Updating complete for: Muse 2012-01-31 13:26:23 INFO Now adding/updating album: Arcana 2012-01-31 13:26:15 WARNING Attempt to retrieve information from MusicBrainz for release group "133f03c7-e6de-3c3b-ac52-ac783289b4c8" failed. Sleeping 5 seconds 2012-01-31 13:26:09 WARNING Attempt to retrieve information from MusicBrainz for release group "133f03c7-e6de-3c3b-ac52-ac783289b4c8" failed. Sleeping 5 seconds 2012-01-31 13:26:04 WARNING Attempt to retrieve information from MusicBrainz for release group "133f03c7-e6de-3c3b-ac52-ac783289b4c8" failed. Sleeping 5 seconds 2012-01-31 13:25:57 WARNING Attempt to query MusicBrainz for Muse failed: HTTP Error 503: 2012-01-31 13:25:56 INFO Now adding/updating: Muse


Reply to this email directly or view it on GitHub: https://github.com/rembo10/headphones/issues/454#issuecomment-3738063

flippedcracker commented 12 years ago

I'm having the same issue, Headphones not finding albums. I'm using a musicbrainz mirror and it gets artist information, but not albums.

jdoggvt commented 12 years ago

I'm using the 'standard' (non-mirror) win32 version and I'm getting the same thing still too.

On Tue, Feb 7, 2012 at 12:08 PM, Robert Mills < reply@reply.github.com

wrote:

I'm having the same issue, Headphones not finding albums. I'm using a musicbrainz mirror and it gets artist information, but not albums.


Reply to this email directly or view it on GitHub: https://github.com/rembo10/headphones/issues/454#issuecomment-3851805

MaienM commented 12 years ago

By now it has indeed fetched details for Guns 'n Roses for me, a list of compilations and live albums... but no regular albums? Is this related to this bug or should I open another one for this?

I'd attach logs, but the logs page gives me an error:

Error !
UnicodeDecodeError: 'ascii' codec can't decode byte 0xf4 in position 75: ordinal not in range(128) 25 <tr class="grade${grade}"> 26 <td id="timestamp">${timestamp}</td> 27 <td id="level">${level}</td> 28 <td id="message">${message}</td> 29 </tr> 30 %endfor 31 </tbody> 32 </table> 33 </%def> /opt/headphones/data/interfaces/default/logs.html, line 28: <td id="message">${message}</td> /opt/headphones/data/interfaces/default/base.html, line 68: ${next.body()} /opt/headphones/mako/runtime.py, line 718: callable_(context, *args, **kwargs) /opt/headphones/mako/runtime.py, line 692: _exec_template(inherit, lclcontext, args=args, kwargs=kwargs) /opt/headphones/mako/runtime.py, line 660: **_kwargs_for_callable(callable_, data)) /opt/headphones/mako/template.py, line 296: return runtime._render(self, self.callable_, args, data) /opt/headphones/headphones/webserve.py, line 27: return template.render(**kwargs)
flippedcracker commented 12 years ago

trying to update Maroon 5, and i get this:

2012-02-07 10:17:27 INFO Updating complete for: Maroon 5 2012-02-07 10:17:26 INFO Unable to get release information for Hands All Over - there may not be any official releases in this release group 2012-02-07 10:17:20 INFO Unable to get release information for It Won't Be Soon Before Long - there may not be any official releases in this release group 2012-02-07 10:17:07 WARNING Attempt to retrieve information from MusicBrainz for release group "6c5fc028-4610-3705-9163-404d1c7a4e2c" failed. Sleeping 5 seconds 2012-02-07 10:17:05 INFO Unable to get release information for Songs About Jane - there may not be any official releases in this release group 2012-02-07 10:16:48 WARNING Attempt to retrieve information from MusicBrainz for release group "93d5a1d1-73c0-34d3-b7f1-49473c48face" failed. Sleeping 5 seconds 2012-02-07 10:16:45 INFO Now adding/updating: Maroon 5

So it gets the album names, but doesn't find official releases even though each has multiple official releases (maybe the problem is multiples in a release group?)

flippedcracker commented 12 years ago

hmm, just restarted headphones, and now it's finding albums for the artists that it was missing before.

danfozzy commented 12 years ago

im experiencing the same issuse with exactly the same errors, unfortunately restarting isnt doing anything for me. If i search for the album and add it, it has no problem, yet for artists it wont add the albums coming up with the same " there may not be any official releases in this release group " error

danfozzy commented 12 years ago

any news on this???

rembo10 commented 12 years ago

Sorry, still working on it On Feb 10, 2012 10:44 PM, "danfozzy" < reply@reply.github.com> wrote:

any news on this???


Reply to this email directly or view it on GitHub: https://github.com/rembo10/headphones/issues/454#issuecomment-3915769

pilothaz commented 12 years ago

Seeing this issue now on my new artists. Hope all is well and this can be remedied soon.

Thanks rembo10!

rembo10 commented 12 years ago

Using tbueter.com as the default mirror now (you can switch back to musicbrainz in the config, or also use a local server) . It's pretty zippy now and fixes the 503 unavailable errors

farfromrefug commented 12 years ago

if i may, why not use Discogs:http://www.discogs.com/developers/ They have a really good API, and they database is pretty great.

By the way, i am using tbueter now, and didnt get any error yet. I am waiting to scan my whole database to see how it goes (missing album, etc ...)

Thank you

simonk83 commented 12 years ago

Just updated to the latest version, and this is now happening to me:

27-May-2012 12:39:04 - WARNING :: Thread-12 : Attempt to retrieve information fr om MusicBrainz for release group "e23390e2-a8b6-3089-a536-96a489ce3a44" failed ( HTTP Error 503: Service Unavailable) 27-May-2012 12:39:10 - WARNING :: Thread-12 : Attempt to retrieve information fr om MusicBrainz for release group "e23390e2-a8b6-3089-a536-96a489ce3a44" failed ( HTTP Error 503: Service Unavailable) 27-May-2012 12:39:15 - WARNING :: Thread-12 : Attempt to retrieve information fr om MusicBrainz for release group "e23390e2-a8b6-3089-a536-96a489ce3a44" failed ( HTTP Error 503: Service Unavailable) 27-May-2012 12:39:21 - WARNING :: Thread-12 : Attempt to retrieve information fr om MusicBrainz for release group "e23390e2-a8b6-3089-a536-96a489ce3a44" failed ( HTTP Error 503: Service Unavailable) 27-May-2012 12:39:26 - WARNING :: Thread-12 : Attempt to retrieve information fr om MusicBrainz for release group "e23390e2-a8b6-3089-a536-96a489ce3a44" failed ( HTTP Error 503: Service Unavailable) 27-May-2012 12:39:32 - WARNING :: Thread-12 : Attempt to retrieve information fr om MusicBrainz for release group "3e787a1d-cb1b-3d93-854f-244e3f028f89" failed ( HTTP Error 503: Service Unavailable) 27-May-2012 12:39:37 - WARNING :: Thread-12 : Attempt to retrieve information fr om MusicBrainz for release group "3e787a1d-cb1b-3d93-854f-244e3f028f89" failed ( HTTP Error 503: Service Unavailable) 27-May-2012 12:39:44 - INFO :: Thread-12 : Unable to get release information for Goldfinger - there may not be any official releases in this release group 27-May-2012 12:39:45 - WARNING :: Thread-12 : Attempt to retrieve information fr om MusicBrainz for release group "f200a063-a5c8-3479-8658-50a6bcaf60d5" failed ( HTTP Error 503: Service Unavailable) 27-May-2012 12:39:50 - WARNING :: Thread-12 : Attempt to retrieve information fr om MusicBrainz for release group "f200a063-a5c8-3479-8658-50a6bcaf60d5" failed ( HTTP Error 503: Service Unavailable)

etc etc etc