rembo10 / headphones

Automatic music downloader for SABnzbd
GNU General Public License v3.0
3.4k stars 600 forks source link

nzb.su - HTTP Error 403: Forbidden #955

Closed CeterPushing closed 11 years ago

CeterPushing commented 11 years ago

This is from the Admin of the site, all I know is headphones at the moment is blocked from searches:

I've recently blocked anything that is not properly identifying itself in the user-agent field. Namely, this was due to an application that looks to be 'headphones' hammering the shit out of our services. Apparently there is no hardcoded low value on how often to search...

People have objects to search for with 1,000 of requests, and set the interval to search at 5minutes. This results never-ending server hammering.

So:

  1. if you use headphones, correct it now. we will start banning accounts that don't set their search parameters to something a bit more reasonable.
  2. if you use headphones, go to their forums and tell them their application is not identifying itself in the url, and to please fix it
  3. if you you some other app that is getting a 403, it also needs to be fixed.

Thanks

rembo10 commented 11 years ago

User-agent added. Thanks for the heads up. The minimum search interval is now 6 hours and the default is 24 hours. Hopefully that will clear things up but let me know if you need me to bump the minumum up to 12 or 24 hours

Thanks again for the heads up, and the awesome site

rembo10 commented 11 years ago

Adding the user agent cleared things up for a bit but it's back to getting 403 errors. Any reason why? Anything else I can do to fix it??

baikunz commented 11 years ago

@rembo10 search is working. however nzb downloading is not : Error fetching nzb from url: xxx HTTP Error 403: Forbidden

You may have to edit this request : https://github.com/rembo10/headphones/blob/master/headphones/searcher.py#L634

rembo10 commented 11 years ago

ah thats what it was. fixed - and thanks for the heads up!

CeterPushing commented 11 years ago

Thank you for addressing this , much appreciated!

CBers commented 11 years ago

Also getting this - headphones is uptodate:

Error fetching data from https://nzb.su: HTTP Error 403: Forbidden

Enverex commented 11 years ago

Ditto, I'm getting it too which is making Headphones a bit useless with NZB-su being the only indexer left that I'm part of.

yidhoe commented 11 years ago

Me too, Sickbeard & Couch are fine but Headphones cant talk to NZB.SU, I have 4 other sites working though so it isn't the end of the world, for reference I have tried with "NZB.su" "NZB.su/" "http://NZB.su" "http://NZB.su/" and all fail, in the logs it appears to be appending a colon ":" on the end of the URL, I.E. "http://NZB.su/:".

Redlake73 commented 11 years ago

I'm getting this too. Any update on what the problem is?

Error fetching data from https://nzb.su: HTTP Error 403: Forbidden

CBers commented 11 years ago

@Redlake73 - have read this: https://github.com/rembo10/headphones/issues/1030

CBers commented 11 years ago

Just done an update and searcher.py has been modified, and the UserAgent string hasn't been changed so getting the FORBIDDEN message again !!

Time to update the searcher.py file again :-(

kylerw commented 11 years ago

Same thing here, FYI.

Bottsie commented 11 years ago

Same here as well

Trixter69 commented 11 years ago

ditto getting the "Error fetching data from http://nzb.su: HTTP Error 403: Forbidden" error

CBers commented 11 years ago

Have you updated the searcher.py file again ??

rembo10 commented 11 years ago

I'm not sure what I can do about this since we're sending the user agent and there is a hard limit for the search interval. Any ideas? On Apr 19, 2013 2:54 PM, "CBers" notifications@github.com wrote:

Have you updated the searcher.py file again ??

— Reply to this email directly or view it on GitHubhttps://github.com/rembo10/headphones/issues/955#issuecomment-16640396 .

CBers commented 11 years ago

Spoofing the user agent is the only answer at the moment, until it gets blocked again.

So many users, so many wanted albums, so many calls.

You've created too good a program :)

CBers commented 11 years ago

Have you seen this: http://howdoiuse.net/headphones/headphones-searches-failing-always-getting-403-errors/

And this: http://howdoiuse.net/headphones/should-nzb-su-support-headphones-poll/