search

YAMJ / yamj-v2

Yet Another Movie Jukebox (YAMJ) v2
GNU General Public License v3.0
28 stars 11 forks source link

Plugin error with NFO when searching IMDb #1569

Closed Omertron closed 9 years ago

Omertron commented 9 years ago

Original issue 1570 created by Omertron on 2010-08-28T11:24:19.000Z:

NFO:

<movie>
<id moviedb="allocine">108806</id> <genre>Drame</genre>
<genre>Sous-titres anglais</genre>
</movie>

moviejukebox.properties:

mjb.internet.plugin=com.moviejukebox.plugin.AllocinePlugin poster.scanner.SearchPriority.movie=allocine,moviecovers,imdb,impawards,motechnet,google,yahoo

Error:

{13:04:12 Thread-8} PosterScanner: I:\Water (2005).Deepa Mehta.VOSTEN.jpg has been copied to C:\YAMJ3\temp\Jukebox\Water (2005).Deepa Mehta.VOSTEN.jpg {13:04:13 Thread-8} AllocinePlugin: No Allocine Id available, we fall back to ImdbPlugin {13:04:14 Thread-8} Failed retreiving IMDb data for movie : 108806 {13:04:19 Thread-8} java.io.FileNotFoundException: http://www.imdb.com/title/108806/ at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at sun.net.www.protocol.http.HttpURLConnection$6.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at sun.net.www.protocol.http.HttpURLConnection.getChainedException(Unknown Source) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.tools.WebBrowser.request(WebBrowser.java:118) at com.moviejukebox.tools.WebBrowser.request(WebBrowser.java:77) at com.moviejukebox.plugin.ImdbPlugin.updateImdbMediaInfo(ImdbPlugin.java:122) at com.moviejukebox.plugin.ImdbPlugin.scan(ImdbPlugin.java:80) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:409) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:70) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1165) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:740) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:725) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:115) Caused by: java.io.FileNotFoundException: http://www.imdb.com/title/108806/ at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at sun.net.www.protocol.http.HttpURLConnection.getHeaderFields(Unknown Source) at com.moviejukebox.tools.WebBrowser.readHeader(WebBrowser.java:252) at com.moviejukebox.tools.WebBrowser.request(WebBrowser.java:113) ... 14 more

The result is no plot, no cast, no director... only info from the NFO...

Can you help?

Omertron commented 9 years ago

Comment #1 originally posted by Omertron on 2010-08-28T11:25:56.000Z:

Of course, Allocine id is valid, and the site was up when indexing.

Omertron commented 9 years ago

Comment #2 originally posted by Omertron on 2010-08-28T11:38:57.000Z:

FYI, I tried 5 mns later with v2.0 r1668 and it worked.

Omertron commented 9 years ago

Comment #3 originally posted by Omertron on 2010-08-28T14:10:24.000Z:

<empty>

Omertron commented 9 years ago

Comment #4 originally posted by Omertron on 2010-08-28T14:32:56.000Z:

Stuart, why have you set the status to invalid?

Omertron commented 9 years ago

Comment #5 originally posted by Omertron on 2010-08-28T17:15:43.000Z:

You said that you re-ran and it worked when the site was online. Therefore I concluded that this was a local problem not YAMJ.

Omertron commented 9 years ago

Comment #6 originally posted by Omertron on 2010-08-29T06:42:27.000Z:

That's not exactly what I said. The site was online when the error occured. And I had to downgrade to 2.0 r1668 to make it work. This is a r1754 issue.

Omertron commented 9 years ago

Comment #7 originally posted by Omertron on 2010-08-29T10:23:34.000Z:

I mean this is a real issue: Allocine plugin doesn't work at all anymore! Could you please re-activate that issue? Thanks.

Omertron commented 9 years ago

Comment #8 originally posted by Omertron on 2010-08-30T10:56:35.000Z:

<empty>

Omertron commented 9 years ago

Comment #9 originally posted by Omertron on 2010-08-30T11:36:02.000Z:

What info are you waiting for?

Omertron commented 9 years ago

Comment #10 originally posted by Omertron on 2010-08-31T11:35:23.000Z:

None from you, it's more of a "It needs to be tested and looked at" status

Omertron commented 9 years ago

Comment #11 originally posted by Omertron on 2010-08-31T17:56:37.000Z:

OK. Thanks to have a look at it, because now I can't go further than r1745!

Omertron commented 9 years ago

Comment #12 originally posted by Omertron on 2010-08-31T18:46:44.000Z:

Does r1746 not work for you?

Omertron commented 9 years ago

Comment #13 originally posted by Omertron on 2010-09-01T06:14:36.000Z:

r1746 is not available any more on the site. If you put it back, I'll test it.

Omertron commented 9 years ago

Comment #14 originally posted by Omertron on 2010-09-01T07:31:43.000Z:

Try r1749 that's on the site. There's not much changed there. I'm interested as to what revision broken the functionality because there's not changes to the Allocine plugin since r1731

Omertron commented 9 years ago

Comment #15 originally posted by Omertron on 2010-09-01T10:41:37.000Z:

I tried with r1749: it worked. Then with with r1759: no error!

I don't know what happened with r1754... You can close that issue.

Thanks a lot for helping.

Omertron commented 9 years ago

Comment #16 originally posted by Omertron on 2010-09-01T11:01:14.000Z:

<empty>

Omertron commented 9 years ago

Comment #17 originally posted by Omertron on 2010-09-02T11:31:33.000Z:

Sorry Stuart, you have to re-open that one. I have added 4 new movies today. One of them was correctly retrieved from Allocine, but not the other 3. I checked it with r1749, so problems may have started around that release...

Here is the trace for one of the 3 (it is similar for the 2 others that failed): {12:47:08 Thread-9} Processing new video : Les Rivières Pourpres 2 {12:47:08 Thread-9} Found NFO: G:\Les Rivières Pourpres 2 - x264.1080p.DTS.FR.nfo {12:47:08 Thread-9} Checking for NFO: G:\Les Rivières Pourpres 2 - x264.1080p.DTS.FR.NFO.TXT {12:47:08 Thread-9} Checking for NFO: G:\NFO\Les Rivières Pourpres 2 - x264.1080p.DTS.FR.NFO {12:47:08 Thread-9} Checking for NFO: G:\NFO\Les Rivières Pourpres 2 - x264.1080p.DTS.FR.NFO.TXT {12:47:08 Thread-9} Checking for NFO: G:.NFO {12:47:08 Thread-9} Checking for NFO: G:.NFO.TXT {12:47:08 Thread-9} Jukebox XML file not found: S:\All_Films\Jukebox\Les Rivières Pourpres 2 - x264.1080p.DTS.FR.xml {12:47:08 Thread-9} Scanning for information on Les Rivières Pourpres 2 - x264.1080p.DTS.FR {12:47:08 Thread-15} OpenSubtitles Plugin: Skipping subtitle download for Les Regrets, subtitles already exist: nl {12:47:08 Thread-9} Scanning NFO file for Infos: Les Rivières Pourpres 2 - x264.1080p.DTS.FR.nfo {12:47:08 Thread-9} In parseMovieNFO Id=47703 found for default IMDB {12:47:08 Thread-9} Set added : Les Rivières Pourpres, order : null {12:47:08 Thread-9} The file G:\Les Rivières Pourpres 2 - x264.1080p.DTS.FR.jpg found {12:47:08 Thread-9} PosterScanner: Poster file G:\Les Rivières Pourpres 2 - x264.1080p.DTS.FR.jpg found {12:47:09 Thread-9} PosterScanner: G:\Les Rivières Pourpres 2 - x264.1080p.DTS.FR.jpg has been copied to C:\YAMJ\temp\Jukebox\Les Rivières Pourpres 2 - x264.1080p.DTS.FR.jpg {12:47:13 Thread-9} AllocinePlugin: No Allocine Id available, we fall back to ImdbPlugin {12:47:14 Thread-9} Failed retreiving IMDb data for movie : 47703 {12:47:14 Thread-9} java.io.FileNotFoundException: http://www.imdb.com/title/47703/ at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at sun.net.www.protocol.http.HttpURLConnection$6.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at sun.net.www.protocol.http.HttpURLConnection.getChainedException(Unknown Source) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at com.moviejukebox.tools.WebBrowser.request(WebBrowser.java:118) at com.moviejukebox.tools.WebBrowser.request(WebBrowser.java:77) at com.moviejukebox.plugin.ImdbPlugin.updateImdbMediaInfo(ImdbPlugin.java:122) at com.moviejukebox.plugin.ImdbPlugin.scan(ImdbPlugin.java:80) at com.moviejukebox.plugin.AllocinePlugin.scan(AllocinePlugin.java:409) at com.moviejukebox.plugin.DatabasePluginController.scan(DatabasePluginController.java:70) at com.moviejukebox.MovieJukebox.updateMovieData(MovieJukebox.java:1165) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:740) at com.moviejukebox.MovieJukebox$3.call(MovieJukebox.java:725) at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) at com.moviejukebox.tools.ThreadExecutor$ScheduledThread.run(ThreadExecutor.java:115) Caused by: java.io.FileNotFoundException: http://www.imdb.com/title/47703/ at sun.net.www.protocol.http.HttpURLConnection.getInputStream(Unknown Source) at sun.net.www.protocol.http.HttpURLConnection.getHeaderFields(Unknown Source) at com.moviejukebox.tools.WebBrowser.readHeader(WebBrowser.java:252) at com.moviejukebox.tools.WebBrowser.request(WebBrowser.java:113) ... 14 more {12:47:14 Thread-9} Updating poster for: Les Rivières Pourpres 2 {12:47:14 Thread-9} Finished: Les Rivières Pourpres 2 (1390/2165)

In the NFO, I have:

47703 Les Rivières Pourpres

That NFO is UTF-8 encoded because of the accented chatacter.

The problem seems to occur when NFOs are xml formatted (which is the case for the 3 which failed). Is seems there is problem when decoding 47703.

Seems to work when there is a full Allocine http link (which is the case for the one that was correctly retrieved).

After reinstalling r1745, deleting the 4 movies from the jukebox folder and reindexing, all 4 movies are OK.

So, as I said, I can't go further than r1745.

Omertron commented 9 years ago

Comment #18 originally posted by Omertron on 2010-09-02T12:11:57.000Z:

Excellent, thats for the detailed report, I should be able to replicate that

Omertron commented 9 years ago

Comment #19 originally posted by Omertron on 2010-09-03T16:25:21.000Z:

<empty>

Omertron commented 9 years ago

Comment #20 originally posted by Omertron on 2010-09-03T16:26:46.000Z:

This issue was closed by revision r1765.

Omertron commented 9 years ago

Comment #21 originally posted by Omertron on 2010-09-03T16:47:31.000Z:

Mediaplayer site is down since this morning, so I can't test it. But I'm not sure you fixed everything in that issue. In fact there are 2 problems:

  1. YAMJ can't find the movie on Allocine, although id is correct. {12:47:13 Thread-9} AllocinePlugin: No Allocine Id available, we fall back to ImdbPlugin
  2. YAMJ tries to search Imdb with Allocine id. {12:47:14 Thread-9} Failed retreiving IMDb data for movie : 47703

After reading your comments, I think you have fixed issue 2, but I'm not sure about issue 1.

A guy reported the same issue with the FilmDeltaSE plugin: http://www.networkedmediatank.com/showthread.php?tid=43577

Anyway, thanks for hrlping so fast!

Omertron commented 9 years ago

Comment #22 originally posted by Omertron on 2010-09-03T17:00:58.000Z:

Ha! Found and squashed that one too :D

Omertron commented 9 years ago

Comment #23 originally posted by Omertron on 2010-09-03T18:10:22.000Z:

Great! Thanks! Any idea what happens to mediaplayer site? Back soon? I long to test r1765!

Omertron commented 9 years ago

Comment #24 originally posted by Omertron on 2010-09-03T20:13:27.000Z:

Thanks, Stuart, I'll try it right now!

Omertron commented 9 years ago

Comment #25 originally posted by Omertron on 2010-09-03T20:20:31.000Z:

Mmmm. For the time being, it starts like this:

Omertron commented 9 years ago

Comment #26 originally posted by Omertron on 2010-09-03T20:24:00.000Z:

Properties:

mjb.internet.plugin=com.moviejukebox.plugin.AllocinePlugin mjb.MaxThreadsDownload=10 mjb.MaxThreadsProcess=10 mjb.internet.tv.plugin=com.moviejukebox.plugin.TheTvDBPlugin thetvdb.language=fr mjb.MaxDownloadSlots=._=2,.imdb.=4,.google.=10,.yahoo.=10,.themoviedb.=1,.thetvdb.=1,.apple.=2,._allocine.*=8

mjb.extensions=AVI DIVX MKV WMV M2TS TS RM QT ISO VOB MPG MOV MP4 M1V M2V M4V M2P TP TRP M2T MTS ASF RMP4 IMG DVR-MS WTV

mjb.extensions=AVI DIVX MKV WMV M2TS TS RM QT ISO VOB MPG MOV MP4 M1V M2V M4V M2P TP TRP M2T MTS ASF RMP4 IMG DVR-MS avi divx mkv wmv m2ts ts rm qt iso vob mpg mov mp4 m1v m2v m4v m2p tp trp m2t mts asf rmp4 img dvr-ms mjb.sets.indexFanart=true

opensubtitles.language=fre

mjb.xmlGenreFile=My_genres.xml mjb.xmlCategoryFile=My_categories.xml mjb.appendDateToLogFile=true mjb.logTimeStamp=true mjb.logThreadName=true

Check to see if the NFO file has changed and force a re-scan of the movie if it is.

filename.nfo.checknewer=false
mjb.forceXMLOverwrite=false
mjb.forceThumbnailsOverwrite=false
mjb.forcePostersOverwrite=false
mjb.forceHTMLOverwrite=false
mjb.recheck.Version=false
mjb.recheck.Days=0
mjb.recheck.Revision=100
mjb.categories.minCount=3
poster.scanner.SearchPriority.movie=allocine,moviecovers,imdb,impawards,motechnet,google,yahoo
mjb.categories.indexList=Genres,Year,Director,Cast,Country,Other,Title,Library 
mjb.categories.displayList=Genres,Year,Director,Cast,Country,Library
mjb.sets.indexFanart=true
mjb.sets.createPosters=true
mjb.sets.minSetCount=1
mjb.playFullBluRayDisk=true
mjb.listing.plugin=com.moviejukebox.plugin.MovieListingPluginCustomCsv
mjb.listing.generate=true
mjb.listing.output.filename=MovieJukebox-listing
mjb.listing.csv.fields=TITLE,YEAR,RUNTIME,DIRECTOR,CAST,GENRES,PLOT,LANGUAGE,RATING,SUBTITLES,LASTMODIFIEDDATE,LIBRARYDESCRIPTION,FILESIZE
mjb.listing.csv.delimiter=@
mjb.listing.clear.UNKNOWN=true
mjb.listing.csv.dateFormat=dd/MM/yyyy
mjb.listing.output.destination=Z:\Pan Data\
mjb.forceSkinOverwrite=false
Omertron commented 9 years ago

Comment #27 originally posted by Omertron on 2010-09-03T20:44:38.000Z:

My mistake, uploading a new version now

Omertron commented 9 years ago

Comment #28 originally posted by Omertron on 2010-09-03T20:45:47.000Z:

OK, I long for it!

Omertron commented 9 years ago

Comment #29 originally posted by Omertron on 2010-09-03T20:49:41.000Z:

Downloading...

Omertron commented 9 years ago

Comment #30 originally posted by Omertron on 2010-09-03T20:52:45.000Z:

Indexing...

Omertron commented 9 years ago

Comment #31 originally posted by Omertron on 2010-09-03T21:27:22.000Z:

Indexing done... Took some time... After checking, everything looks right now for xml NFO's. You did a great job, Stuart, thanks again!

However, I found this: Movie: Happy Together (2007).VOSTFR.ISO

NFO: http://www.imdb.com/title/tt1087892/

There is a similar movie (same title) (also in my library), named: Happy Together (1997). Wong Kar-Wai .VOSTFR.mkv with NFO: http://www.allocine.fr/film/fichefilm_gen_cfilm=12025.html

Result is that both show up with the same Allocine tags (see attachments). The first one should show Imdb tags but it doesn't.

Line 12647: {22:56:59 Thread-12} Processing new video : Happy Together Line 12648: {22:56:59 Thread-12} Found NFO: Q:\Happy Together (2007).VOSTFR.nfo Line 12649: {22:56:59 Thread-12} Checking for NFO: Q:\Happy Together (2007).VOSTFR.NFO.TXT Line 12650: {22:56:59 Thread-12} Checking for NFO: Q:\NFO\Happy Together (2007).VOSTFR.NFO Line 12651: {22:56:59 Thread-12} Checking for NFO: Q:\NFO\Happy Together (2007).VOSTFR.NFO.TXT Line 12658: {22:56:59 Thread-12} Checking for NFO: Q:.NFO Line 12659: {22:56:59 Thread-12} Checking for NFO: Q:.NFO.TXT Line 12660: {22:56:59 Thread-12} Jukebox XML file not found: S:\All_Films\Jukebox\Happy Together (2007).VOSTFR.xml Line 12661: {22:56:59 Thread-12} Scanning for information on Happy Together (2007).VOSTFR Line 13067: {22:57:01 Thread-12} Start processing IFO file. Line 13068: {22:57:01 Thread-12} Processing IFO file done. Line 13069: {22:57:01 Thread-12} Start processing IFO file. Line 13070: {22:57:01 Thread-12} Processing IFO file done. Line 13071: {22:57:01 Thread-12} Start processing IFO file. Line 13072: {22:57:01 Thread-12} Processing IFO file done. Line 13073: {22:57:01 Thread-12} Start processing IFO file. Line 13074: {22:57:01 Thread-12} Processing IFO file done. Line 13075: {22:57:01 Thread-12} Start processing IFO file. Line 13076: {22:57:01 Thread-12} Processing IFO file done. Line 13077: {22:57:01 Thread-12} Start processing IFO file. Line 13078: {22:57:01 Thread-12} Processing IFO file done. Line 13079: {22:57:01 Thread-12} Start processing IFO file. Line 13080: {22:57:01 Thread-12} Processing IFO file done. Line 13081: {22:57:01 Thread-12} Start processing IFO file. Line 13082: {22:57:01 Thread-12} Processing IFO file done. Line 13098: {22:57:01 Thread-12} Scanning NFO file for Infos: Happy Together (2007).VOSTFR.nfo Line 13100: {22:57:01 Thread-12} Scanning NFO for Imdb Id Line 13101: {22:57:01 Thread-12} Imdb Id found in nfo: tt1087892 Line 13102: {22:57:01 Thread-12} AllocinePlugin: Scanning NFO for Allocine Id Line 13103: {22:57:01 Thread-12} AllocinePlugin: No Allocine Id found in nfo ! Line 13104: {22:57:01 Thread-12} Scanning NFO for Poster URL Line 13105: {22:57:01 Thread-12} The file Q:\Happy Together (2007).VOSTFR.jpg found Line 13106: {22:57:01 Thread-12} PosterScanner: Poster file Q:\Happy Together (2007).VOSTFR.jpg found Line 13177: {22:57:02 Thread-12} PosterScanner: Q:\Happy Together (2007).VOSTFR.jpg has been copied to C:\YAMJ\temp\Jukebox\Happy Together (2007).VOSTFR.jpg Line 13190: {22:57:02 Thread-12} IO download host: www.google.fr; rule: .google. Line 13328: {22:57:03 Thread-12} IO download host: www.allocine.fr; rule: .allocine. Line 15441: {22:57:12 Thread-12} Genre added : Comédie dramatique Line 15490: {22:57:12 Thread-12} FanartScanner: Error no fanart found for Happy Together (2007).VOSTFR Line 16372: {22:57:16 Thread-12} Updating poster for: Happy Together Line 16373: {22:57:16 Thread-12} OpenSubtitles Plugin: Skipping subtitle download for Happy Together, subtitles already exist: YES / en / fr Line 16374: {22:57:16 Thread-12} Finished: Happy Together (581/2165)

Omertron commented 9 years ago

Comment #32 originally posted by Omertron on 2010-09-03T21:31:16.000Z:

<empty>

Omertron commented 9 years ago

Comment #33 originally posted by Omertron on 2010-09-04T05:56:23.000Z:

Allocine is the engine of choice, it'll look there and find the movie first and use that info, even if it's "wrong" The best you can do is point it to the allocine film that's correct (if there is one) as there isn't a way at the moment to skip the processing of a movie and revert to IMDb

Omertron commented 9 years ago

Comment #34 originally posted by Omertron on 2010-09-04T12:43:59.000Z:

Stuart, isn't the NFO searched in priority before the filename? I think it's alway been like that.

In my case (Happy Together 2007), there is a valid imdb link in the NFO (http://www.imdb.com/title/tt1087892/ ), but YAMJ doesn't search for it, and searches Allocine for the title!

Omertron commented 9 years ago

Comment #35 originally posted by Omertron on 2010-09-05T12:35:09.000Z:

Yes, the NFO is, but only to override any data that is sourced from the internet site. So, because you don't have an allocine ID in the file won't stop YAMJ from searching for that film.

And because it finds a close match, then it assumes that is the right film and gets it.

perhaps YAMJ needs a < id>moviedb="allocine">0</ id> line which will skip searching on that scraper site

Omertron commented 9 years ago

Comment #36 originally posted by Omertron on 2010-09-05T15:12:56.000Z:

Well, it seems to work like that:

moviedb="allocine">0 tt1087892

However, I think it would be logical if the NFO could be scanned prior to the filename and default plugin. I mean, if we have built a NFO, it is because we want it to be used!

Don't you agree with me?