YAMJ / yamj-v2

Yet Another Movie Jukebox (YAMJ) v2
GNU General Public License v3.0
28 stars 11 forks source link

All persons always included in person index #2278

Closed Omertron closed 9 years ago

Omertron commented 9 years ago

Original issue 2279 created by Omertron on 2012-01-16T16:48:47.000Z:

What steps will reproduce the problem?

  1. After YAMJ 2.5.1 mjb.people.maxcount does not limit the size of the index. It only limits the number of persons scanned by the people scanner. Also fails up thru r2885.
  2. mjb.people.popularity doesn't limit the person index either. It is every person from every movie. It is huge.
  3. Using an older skin that does not support people scanner, so the person index is used for finding movies with people in it.

What is the expected output? What do you see instead? person index is excessively large. Tens of thousands of people

What version/revision of YAMJ are you using? On what operating system? Started with YAMJ 2.5.1, but also occurs up thru r2885

What skin are you using? AEONskin, but also fails for eversion

What device are you using YAMJ on? Networked Media Tank, PlayonHD, Other? YAMJ is run on a windows 7 machine Please provide any additional information below.

property settings: mjb.people=true mjb.people.popularity=2 mjb.includePhoto=false mjb.people.maxCount=1000 mjb.categories.indexList=Other,Genres,Title,Certification,Year,Country,Set,Person mjb.view.personList=

Omertron commented 9 years ago

Comment #1 originally posted by Omertron on 2012-01-17T03:00:58.000Z:

Read the wiki [PropertiesConfiguration] for correct use of the parameters. Decrease parameter mjb.people.maxCount. Increase the value of mjb.people.popularity. Example: mjb.people.maxCount=25 mjb.people.popularity=10 It should result in only 25 popular people.

Omertron commented 9 years ago

Comment #2 originally posted by Omertron on 2012-01-17T04:48:43.000Z:

Hi,

That is the way I think it should work. With mjb.people.maxcount=1000 the person index has 30k people in it. However, the people scanner only scans 1000 people.

Sent from Stephen's iPad. Please excuse brevity and typos.

Omertron commented 9 years ago

Comment #3 originally posted by Omertron on 2012-01-17T05:34:36.000Z:

ok, I think I have identified the issue. If you run YAMJ with mjb.people=false, but have Person in the index, then it populates the index with every person it can find. Subsequent runs (even when you set mjb.people=true) continue to have the huge person index. This continues until you run it again with mjb.forceXMLOverwrite=true.

If you run YAMJ with mjb.people=true then the person index works correctly and the index count is the max that you set up.

Omertron commented 9 years ago

Comment #4 originally posted by Omertron on 2012-01-18T04:41:26.000Z:

I generated the jukebox with the following parameters: mjb.people=true mjb.people.popularity=20 mjb.includePhoto=false mjb.people.maxCount=2000 plugin.people.skip.TV=true mjb.categories.indexList=Other,Genres,Title,Certification,Year,Country,Set,Person

As part of the generation process it produced the following output: Finished: Wallace Shawn (231/231) Add/update people information to the videos... Indexing Libraries... Indexing Other... Indexing Genres... Indexing Title... Indexing Certification... Indexing Country... Indexing Set... Indexing Person... Sorting Indexes ... Indexing masters... Writing Indexes XML... Indexing Genres (1/8) contains 14 indexes Indexing Title (2/8) contains 28 indexes Indexing Certification (3/8) contains 18 indexes Indexing Year (4/8) contains 14 indexes Indexing Country (5/8) contains 62 indexes Indexing Other (6/8) contains 11 indexes Indexing Person (7/8) contains 33546 indexes

It produced a lot of entries in the people index, but not that many. At the end there were approximately 7547 person entries (7547 html files and 7547 xml files of type Person_*). The actual index had about that number of entries.

Many of those indexes had only a few movies. In the log I noticed a lot of entries:

[20:31:41 - Thread-16] Category 'Person Virginia Cherrill' does not contain enough videos (1/3), skipping XML generation. [20:31:41 - Thread-16] Category 'Person Virginia Christine' does not contain enough videos (2/3), skipping XML generation.

It seems to be basing whether to add an index entry on whether there are more than 3 movies with that person even though I have mjb.people.popularity=20

This is r2891.

This is producing some huge jukebox files.

Omertron commented 9 years ago

Comment #5 originally posted by Omertron on 2012-01-18T06:18:10.000Z:

attach your log file

Omertron commented 9 years ago

Comment #6 originally posted by Omertron on 2012-01-18T08:18:58.000Z:

set mjb.categories.minCount.Person=20 to decrease Person index

Omertron commented 9 years ago

Comment #7 originally posted by Omertron on 2012-01-18T15:57:04.000Z:

Thanks,

mjb.categories.minCount.Person worked to reduce the size of the categories. I didn't realize that it could be category specific.

I was mixing the Person and People aspects. I apparently don't need the people scanner at all (at least with my present skin).

You can remove the issue. Thanks, Stephen

Omertron commented 9 years ago

Comment #8 originally posted by Omertron on 2012-01-18T16:15:26.000Z:

<empty>