YAMJ / yamj-v2

Yet Another Movie Jukebox (YAMJ) v2
GNU General Public License v3.0
28 stars 11 forks source link

r3708: Allocine plugin HTTP error 503 is back! #2655

Closed Omertron closed 9 years ago

Omertron commented 9 years ago

Original issue 2658 created by Omertron on 2013-05-21T16:32:49.000Z:

Hi,

After upgrading to r3708 and setting mjb.forceXMLOverwrite=true, I had to cancel the indexing process, because of numerous HTTP 503 errors...

[18:22:34 - Thread-20] ERROR com.moviejukebox.plugin.AllocinePlugin - AllocinePlugin: Failed retrieving Allocine infos for movie : 118343 [18:22:34 - Thread-20] ERROR com.moviejukebox.plugin.AllocinePlugin - java.io.IOException: Server returned HTTP response code: 503 for URL: http://api.allocine.fr/rest/v3/movie?partner=[APIKEY]&profile=large&mediafmt=mp4-lc&striptags=synopsis%2Csynopsisshort&format=json&filter=movie&code=118343&sed=20130521&sig=1Jh4xM67wHDM0Q8s9RfBTJE0MKM%3D at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.allocine.JSONAllocineAPIHelper.getMovieInfos(JSONAllocineAPIHelper.java:161) at com.moviejukebox.plugin.AllocinePlugin.getMovieInfos(AllocinePlugin.java:512) at com.moviejukebox.plugin.AllocinePlugin.updateMovieInfo(AllocinePlugin.java:233) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:221) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:116) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1970) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:947) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:928) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:105)

[18:22:39 - Thread-14] ERROR com.moviejukebox.plugin.AllocinePlugin - AllocinePlugin: Failed retrieving Allocine infos for movie : 54673 [18:22:39 - Thread-14] ERROR com.moviejukebox.plugin.AllocinePlugin - java.io.IOException: Server returned HTTP response code: 503 for URL: http://api.allocine.fr/rest/v3/movie?partner=[APIKEY]&profile=large&mediafmt=mp4-lc&striptags=synopsis%2Csynopsisshort&format=json&filter=movie&code=54673&sed=20130521&sig=mgRiwz%2F6Et2%2FOA8jLZ7dO977C6M%3D at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.allocine.JSONAllocineAPIHelper.getMovieInfos(JSONAllocineAPIHelper.java:161) at com.moviejukebox.plugin.AllocinePlugin.getMovieInfos(AllocinePlugin.java:512) at com.moviejukebox.plugin.AllocinePlugin.updateMovieInfo(AllocinePlugin.java:233) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:221) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:116) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1970) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:947) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:928) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:105)

[18:22:46 - Thread-17] ERROR com.moviejukebox.plugin.AllocinePlugin - AllocinePlugin: Failed retrieving Allocine infos for movie : 111756 [18:22:46 - Thread-17] ERROR com.moviejukebox.plugin.AllocinePlugin - java.io.IOException: Server returned HTTP response code: 503 for URL: http://api.allocine.fr/rest/v3/movie?partner=[APIKEY]&profile=large&mediafmt=mp4-lc&striptags=synopsis%2Csynopsisshort&format=json&filter=movie&code=111756&sed=20130521&sig=O3VEdRSH0ZN5jmsvUBfwPUgqVKw%3D at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.allocine.JSONAllocineAPIHelper.getMovieInfos(JSONAllocineAPIHelper.java:161) at com.moviejukebox.plugin.AllocinePlugin.getMovieInfos(AllocinePlugin.java:512) at com.moviejukebox.plugin.AllocinePlugin.updateMovieInfo(AllocinePlugin.java:233) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:221) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:116) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1970) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:947) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:928) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:105)

[18:23:02 - Thread-26] ERROR com.moviejukebox.plugin.AllocinePlugin - AllocinePlugin: Failed retrieving Allocine infos for movie : 3391 [18:23:02 - Thread-26] ERROR com.moviejukebox.plugin.AllocinePlugin - java.io.IOException: Server returned HTTP response code: 503 for URL: http://api.allocine.fr/rest/v3/movie?partner=[APIKEY]&profile=large&mediafmt=mp4-lc&striptags=synopsis%2Csynopsisshort&format=json&filter=movie&code=3391&sed=20130521&sig=6f1DHUKO1daxtYHVTikMiB%2BG%2BNk%3D at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.allocine.JSONAllocineAPIHelper.getMovieInfos(JSONAllocineAPIHelper.java:161) at com.moviejukebox.plugin.AllocinePlugin.getMovieInfos(AllocinePlugin.java:512) at com.moviejukebox.plugin.AllocinePlugin.updateMovieInfo(AllocinePlugin.java:233) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:221) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:116) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1970) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:947) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:928) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:105)

[18:23:10 - Thread-20] ERROR com.moviejukebox.plugin.AllocinePlugin - AllocinePlugin: Failed retrieving Allocine infos for movie : 133525 [18:23:10 - Thread-20] ERROR com.moviejukebox.plugin.AllocinePlugin - java.io.IOException: Server returned HTTP response code: 503 for URL: http://api.allocine.fr/rest/v3/movie?partner=[APIKEY]&profile=large&mediafmt=mp4-lc&striptags=synopsis%2Csynopsisshort&format=json&filter=movie&code=133525&sed=20130521&sig=RzyCdztsIPMAHGe%2F6Rp1YA7a4Ig%3D at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.allocine.JSONAllocineAPIHelper.getMovieInfos(JSONAllocineAPIHelper.java:161) at com.moviejukebox.plugin.AllocinePlugin.getMovieInfos(AllocinePlugin.java:512) at com.moviejukebox.plugin.AllocinePlugin.updateMovieInfo(AllocinePlugin.java:233) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:221) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:116) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1970) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:947) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:928) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:105)

[18:23:25 - Thread-15] ERROR com.moviejukebox.plugin.AllocinePlugin - AllocinePlugin: Failed retrieving Allocine infos for movie : 23691 [18:23:25 - Thread-15] ERROR com.moviejukebox.plugin.AllocinePlugin - java.io.IOException: Server returned HTTP response code: 503 for URL: http://api.allocine.fr/rest/v3/movie?partner=[APIKEY]&profile=large&mediafmt=mp4-lc&striptags=synopsis%2Csynopsisshort&format=json&filter=movie&code=23691&sed=20130521&sig=7Lygxy0%2B8D5ztaT7vTOddhGJIyo%3D at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.allocine.JSONAllocineAPIHelper.getMovieInfos(JSONAllocineAPIHelper.java:161) at com.moviejukebox.plugin.AllocinePlugin.getMovieInfos(AllocinePlugin.java:512) at com.moviejukebox.plugin.AllocinePlugin.updateMovieInfo(AllocinePlugin.java:233) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:221) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:116) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1970) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:947) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:928) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:105)

[18:23:29 - Thread-15] ERROR com.moviejukebox.plugin.AllocinePlugin - AllocinePlugin: Failed retrieving Allocine infos for movie : 30 [18:23:29 - Thread-15] ERROR com.moviejukebox.plugin.AllocinePlugin - java.io.IOException: Server returned HTTP response code: 503 for URL: http://api.allocine.fr/rest/v3/movie?partner=[APIKEY]&profile=large&mediafmt=mp4-lc&striptags=synopsis%2Csynopsisshort&format=json&filter=movie&code=30&sed=20130521&sig=fpX%2FaELI5%2FxYJjHp6rlDpfvruDc%3D at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.allocine.JSONAllocineAPIHelper.getMovieInfos(JSONAllocineAPIHelper.java:161) at com.moviejukebox.plugin.AllocinePlugin.getMovieInfos(AllocinePlugin.java:512) at com.moviejukebox.plugin.AllocinePlugin.updateMovieInfo(AllocinePlugin.java:233) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:221) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:116) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1970) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:947) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:928) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:105)

[18:23:43 - Thread-20] ERROR com.moviejukebox.plugin.AllocinePlugin - AllocinePlugin: Failed retrieving Allocine infos for movie : 29378 [18:23:43 - Thread-20] ERROR com.moviejukebox.plugin.AllocinePlugin - java.io.IOException: Server returned HTTP response code: 503 for URL: http://api.allocine.fr/rest/v3/movie?partner=[APIKEY]&profile=large&mediafmt=mp4-lc&striptags=synopsis%2Csynopsisshort&format=json&filter=movie&code=29378&sed=20130521&sig=%2FaWq0m0H3Km8nthAGurcct%2FTLC0%3D at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.allocine.JSONAllocineAPIHelper.getMovieInfos(JSONAllocineAPIHelper.java:161) at com.moviejukebox.plugin.AllocinePlugin.getMovieInfos(AllocinePlugin.java:512) at com.moviejukebox.plugin.AllocinePlugin.updateMovieInfo(AllocinePlugin.java:233) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:221) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:116) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1970) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:947) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:928) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:105)

I canceled here... Thanks for your help.

Omertron commented 9 years ago

Comment #1 originally posted by Omertron on 2013-05-26T08:43:45.000Z:

i have the same release (r3708), and now the scan is ok

(yesterday it doesn't work,=> error 503)

Omertron commented 9 years ago

Comment #2 originally posted by Omertron on 2013-05-26T09:56:52.000Z:

Thanks. I will try right now and let you know what happens.

Omertron commented 9 years ago

Comment #3 originally posted by Omertron on 2013-05-26T16:13:12.000Z:

After reindexing today all my jukebox with: mjb.forceXMLOverwrite=true and mjb.recheck.Unknown=true, I get now hundreds of HTTP 503 errors when trying to connect to Google. And there are still some 503 errors when trying to connect to Allocine. Logfiles attached.

Omertron commented 9 years ago

Comment #4 originally posted by Omertron on 2013-06-01T23:32:56.000Z:

I have really no idea what the problem is.

1.) For google There are too many requests on google, so google rejects them. Perhaps the french movies cannot be found on IMDB and so he tries google at least. But then to often ... and google blocks your IP for a some hours ... or less or more ... who knows?

Can you test if you find the titles on imdb.com which throw an error on google search? I cannot test it, cause I have no french IP ..

2.) Allocine Are some allocine requests working or not?

At last: How you have configured you movie scanner? If you use allocine, then the IMDB should normally not be requested.

Omertron commented 9 years ago

Comment #5 originally posted by Omertron on 2013-09-25T09:34:50.000Z:

Fixed a google search issue which resulted in this error.