jdogg172 / tinymediamanager

Automatically exported from code.google.com/p/tinymediamanager
0 stars 0 forks source link

Preffered language for movie metadata scraper #28

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
If preffered language for movie metadata scraper does not exist,
scraper fills nothing to plot field.
In my opinion in this case would be better to fill in english plot.

Original issue reported on code.google.com by zbynek.f...@gmail.com on 15 Jul 2013 at 9:57

GoogleCodeExporter commented 9 years ago
I could try to do a second request to TMDB (which is being scraped with the 
preferred language), which will result in a higher amount of requests (and 
sooner throttling).
Or should I try to get the english version from IMDB if you have chosen the 
IMDB scraper?

Original comment by manuel.l...@gmail.com on 22 Jul 2013 at 11:37

GoogleCodeExporter commented 9 years ago

Original comment by manuel.l...@gmail.com on 22 Jul 2013 at 1:55

GoogleCodeExporter commented 9 years ago
Thanks for thinking of my suggestion.
Higher amount of requests seems to be problem. Is there any possibility to 
contact
creators of Universal Movie Scraper from XBMC 
http://wiki.xbmc.org/index.php?title=Add-on:Universal_Movie_Scraper. It scrapes 
information in english from TMDb if preffered language does not exist.
But according to: http://docs.themoviedb.apiary.io/ only way seems to be 
another request:

"Our API supports translations just like 2.1 did but with an important 
difference—we no longer fall back to English in the event that a field hasn't 
been translated. If you make a request for the German translation and the 
overview hasn’t been translated, the field will be empty. There’s a few 
reasons for this but the main one is that in an effort to encourage users to 
add data to TMDb, it’s important for them to see when the data is missing.

If you want to fall back to English, you can make the separate call yourself 
and fill in missing data."

There is limitation on TMDb request rate:
    30 requests every 10 seconds per IP
    Maximum 20 simultaneous connections

Original comment by zbynek.f...@gmail.com on 23 Jul 2013 at 10:40

GoogleCodeExporter commented 9 years ago
implementing the Universal Music Scraper will bring no benefit, because this 
also connects TMDB for english translation...

What I did is:
-) If you use TMDB scraper (e.g. in german) and no plot/overview is found, 
there will be a second call to TMDB (we already have some sort of throttling 
included)
-) If you use IMDB scraper (and localizeable content from TMDB) and no 
plot/overview is found, the plot will be taken from imdb.

Is this ok?

Original comment by manuel.l...@gmail.com on 24 Jul 2013 at 5:23

GoogleCodeExporter commented 9 years ago
Yes, in my opinion it is OK.
Thanks

Original comment by zbynek.f...@gmail.com on 24 Jul 2013 at 9:59

GoogleCodeExporter commented 9 years ago
ok, it's in r748

Original comment by manuel.l...@gmail.com on 25 Jul 2013 at 5:28