javinizer / Javinizer

(NSFW) Organize your local Japanese Adult Video (JAV) library
MIT License
571 stars 61 forks source link

"Javinizer -SetEmbyThumbs "only grabs less than 100 actress thumbs, all Japanese names, not a single English name #189

Closed beginner0 closed 3 years ago

beginner0 commented 3 years ago

Expected Behavior

Download all actress thumbs in the jvThumbs.csv that came with Javinizer v.2.2.10

Current Behavior

Only downloaded 98 actress names with their thumb images (poster.jpg and landscape.jpg), all names in Japanese, zero English name.

(I tried at least 10 times with different settings in jvSettings.jason file, but the results are all identical: only 98 Japanese names with thumbs downloaded, no English name actress)

Steps to Reproduce (for bugs)

correctly filled in "emby.url" and "emby.apikey" values then run "Javinizer -SetEmbyThumbs " in elevated powershell 7

Your Environment

JellyFin (latest stable version)

jvlflame commented 3 years ago

Can you try running Javinizer -SetEmbyThumbs -Debug? That should give some output on what actresses are being detected.

You can also run the following in PowerShell to view the actresses in your Jellyfin instance:

$apiKey = "CHANGEME"
$url = "http://CHANGEME:8096"
(Invoke-RestMethod -Uri "http://$url/emby/Persons?api_key=$apiKey") | Select-Object Name, Id, ImageTags

Compare the names without images to the ones in the jvThumbs.csv file and make sure they exist in the file.

beginner0 commented 3 years ago

Hi, thank you so much for replying to my post. I just the " Javinizer -SetEmbyThumbs -Debug" successfully, but I don't know where is debugging report, can you tell me where to find it?

On Wed, Jan 20, 2021 at 11:16 PM jvlflame notifications@github.com wrote:

Can you try running Javinizer -SetEmbyThumbs -Debug? That should give some output on what actresses are being detected.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/jvlflame/Javinizer/issues/189#issuecomment-764248561, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTPSRSNFHA77BJA5MSDB6TS26TATANCNFSM4WL7NGBQ .

jvlflame commented 3 years ago

If there was no output, then there were no thumbnails created.

If you do Javinizer -SetEmbyThumbs -ReplaceAll -Debug then there should be output.

beginner0 commented 3 years ago

this is all it returned in powershell console: [image: SNAG-1-20-2021 26.jpg]

On Wed, Jan 20, 2021 at 11:16 PM jvlflame notifications@github.com wrote:

Can you try running Javinizer -SetEmbyThumbs -Debug? That should give some output on what actresses are being detected.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/jvlflame/Javinizer/issues/189#issuecomment-764248561, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTPSRSNFHA77BJA5MSDB6TS26TATANCNFSM4WL7NGBQ .

jvlflame commented 3 years ago

this is all it returned in powershell console: [image: SNAG-1-20-2021 26.jpg] On Wed, Jan 20, 2021 at 11:16 PM jvlflame @.***> wrote: Can you try running Javinizer -SetEmbyThumbs -Debug? That should give some output on what actresses are being detected. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#189 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTPSRSNFHA77BJA5MSDB6TS26TATANCNFSM4WL7NGBQ .

Your image isn't loading for me.

beginner0 commented 3 years ago

Removed image since it contained sensitive information

here is the log file after running the "Javinizer -SetEmbyThumbs -ReplaceAll -Debug", the first half of the log was the records of my last running "Javinizer -SetEmbyThumbs -ReplaceAll", times tamp was 17:48:00, the current records with time stamp 23:35:14

beginner0 commented 3 years ago

both current and last runs returned identical records according to the log file, all English names were converted to Japanese.

beginner0 commented 3 years ago

I just noticed from the console debug output, that the Javinizer added "emby" after the port number, that may be a problem, since I am running JellyFin, Javinizer is looking to find "localhost:8096/emby/Persons/?api_key=......", could that be a problem? I don't have "emby" in my server path.

jvlflame commented 3 years ago

No, the /emby... isn't a problem since Jellyfin uses the same API as Emby. Can you copy and paste your output of the command from above here? That will allow us to further troubleshoot all the actress names within your Jellyfin instance.

$apiKey = "CHANGEME"
$url = "http://CHANGEME:8096"
(Invoke-RestMethod -Uri "http://$url/emby/Persons?api_key=$apiKey") | Select-Object Name, Id, ImageTags
beginner0 commented 3 years ago

Thank you so much. I ran the commands and here is the output:

2021-01-21_10-20-14

jvlflame commented 3 years ago

Sorry.. there was some typos in the command, can you re-run?

$apiKey = "CHANGEME"
$url = "http://CHANGEME:8096"
(Invoke-RestMethod -Uri "$url/emby/Persons?api_key=$apiKey").Items | Select-Object Name, Id, ImageTags
beginner0 commented 3 years ago

I ran the commands again and this time I got output to the console window:

SNAG-1-21-2021 28

beginner0 commented 3 years ago

I have no knowledge of where Jellyfin keeps actor names in the system, but the output did not include any JAV actress name, even though Javinizer did download some thumb images for the actress with Japanese names, is there anything on my end that I need to do to enable Javinizer to correctly download all the actress thumbs in the javthumb.csv file?

beginner0 commented 3 years ago

Here is my thought on this strange problem: I freshly installed Jellyfin this week on this PC that has never installed Jeelyfin before, these actor names mostly come with Jellyfin pre-installed (although some of them are from my adding few non-JAV movies for testing out Jellyfin for the first time), I then added a JAV library with metadata downloaded using JavMovieScraper, but it did not put the actress's thumbs in the Jellyfin's people folder, and no JAV actress thumb was visible, that was the reason I used Javinizer to download actress's thumbs.

Before I run Javinizer, I first deleted all sub-folders under the people folder in Jellyfin server, because I wanted Javinizer to do a fresh download of the entire list of actress thumbs contained in the javthumbs.csv file, I think this may have something to do with the unexpected outcome when I ran Javinizer to download the actress's thumbs. Do you think I should completely uninstall then reinstall Jellyfin, then run Javinizer again to see if that indeed is the cause of this unexpected behavior of Javinizer?

jvlflame commented 3 years ago

I'm not too familiar with how Jellyfin is adding actresses in the backend, but I'm assuming it happens during a movie import.

Reinstalling may be the quickest solution as I don't have a clear answer on why your current Jellyfin instance isn't loading the actresses. All I can say is to make sure you're running the JAV library within Jellyfin as a movie library as well as make sure that the the metadata grabber is using "Nfo" as primary.

beginner0 commented 3 years ago

Thanks for all the help! One last question before I do a complete uninstall of Jellyfin:

if I run "Javinizer -SetEmbyThumbs" after I have uninstalled then reinstalled Jellyfin, but before I have added any movie library (i.e. there is no metadata exist prior to running "Javinizer -SetEmbyThumbs"), will Javinizer download all the actresses thumbs contained in the javthumbs.csv file?

or, Javinizer only downloads actresses that belong to movies that have already added to a movie library, and each movie must be in a separate folder and the folder must contain a .NFO file?

jvlflame commented 3 years ago

The latter, Javinizer detects existing actresses on your Jellyfin server and then populates them on demand. I'm not 100% sure if Jellyfin supports it, but you can download all actress images directly to the movie folders when sorting if you use "sort.download.actressimg": true.

beginner0 commented 3 years ago

Thank you. I think I understand more about how Javinizer works from your last reply. Javinizer did download the actress thumbs for movies that have actress names in Japanse, but for some odd reasons, it had chosen to skip downloading thumbs for actresses whose names are in English. I think I really need to reinstall Jellyfin then experiment with a fresh JAV library that has only a couple of movies with actresses whose names are only in English, to see if Javinizer will download thumbs for the actresses with English names, or if Javinizer will convert the names to Japnese despite that only English names are contained in the .NFO files for these test movies.

I assume that Javinizer reads the actress names by scanning all the .NFO files in folders that added to the Jellyfin movie libraries, and it has nothing to do with Jellyfin's internal database system/files, am I correct on that assumption?

I will report back my findings.

beginner0 commented 3 years ago

I have one off-topic question that I was not able to find answers to by searching on google: does Javinizer scrape metadata for caribbeancom, 1pondo, and FC2?

jvlflame commented 3 years ago

Check the list of scrapers. You may be able to find some of those on AVentertainments, Javbus, jav321. I'm also planning on adding javdb.com in the near future which may include some of those.

beginner0 commented 3 years ago

I am reporting back the results of this issue after removed all libraries and cleared caches:

only few actresses' thumbs were downloaded, not all the name from the above debug output were downloaded, the most puzzling thing is: all names were again converted to Japanese:

jvlflame commented 3 years ago

Can you run the command again as Javinizer -SetEmbyThumbs -ReplaceAll -Verbose (replaced -Debug with -Verbose). This will better show which actresses had images downloaded for it.

beginner0 commented 3 years ago

here is the output:

SNAG-1-22-2021 45

jvlflame commented 3 years ago

I think I see what the issue is now. Since you're using movies that you scraped using JAVMovieScraper, the actress names are currently in "FirstName LastName" format. Javinizer defaults to "LastName FirstName" so that's why it's not downloading the thumbs.

Open the settings file with Javinizer -OpenSettings and update sort.metadata.nfo.firstnameorder to true, and then run the -SetEmbyThumbs command again.

Edit: I'll probably update the functionality in the future to check both naming orders by default.

beginner0 commented 3 years ago

WOW! THAT WORKS! it is downloading now.

Thanks so much for your help!

beginner0 commented 3 years ago

I had to use JAVMovieScraper for caribbeancom movies because Javinizer could not find metadata for it, for example:

movie file: 013114-533.mp4 metadata and imagesexist in javbus:

https://images.javbus.com/cover/bte_b.jpg https://images.javbus.com/actress/3qc.jpg https://images.javbus.com/actress/451.jpg

JAVMovieScraper was able to scrape the metadata images and create the NFO file for this movie (just one example, all 171 movies metadata in this movie libray were all scraped using JAVMovieScraper.

I was unable to use Javinzer to scrape any caribbeancom movies that JAVMovieScraper was able to, could you take a look at your code to see why Javinizer is not scraping javbus.com for cribbeancom movies? or maybe my file name must include some specific words in order for it to scrape cribbeancom movies?

jvlflame commented 3 years ago

I'd recommend going through some of the docs first just to make sure you know how Javinizer file matcher works, and how to enable scrapers and assign metadata.

File Matching Metadata Priorities Settings (You may need to turn on/off scrapers)

Javbus works, but you need to figure out how to make it work (hint: look to use the -Strict param). As an example:

PS C:\> Javinizer -Find 013114-533 -javbus

Source        : javbus
Url           : https://www.javbus.com/en/013114-533
Id            : 013114-533
Title         : AVプロダクション対抗チキチキ海釣り大会 PART2
ReleaseDate   : 2014-01-31
ReleaseYear   : 2014
Runtime       : 60
Director      :
Maker         : Caribbeancom
Label         :
Series        : Caribbeancom
Actress       : {@{LastName=Sakura; FirstName=Sena; JapaneseName=桜瀬奈;
                ThumbUrl=https://images.javbus.com/actress/3qc.jpg}, @{LastName=Kaede; FirstName=Nonohana;
                JapaneseName=楓乃々花; ThumbUrl=https://images.javbus.com/actress/451.jpg}}
Genre         : {乱交, スレンダー, クンニ, Handjob…}
CoverUrl      : https://images.javbus.com/cover/bte_b.jpg
ScreenshotUrl :
beginner0 commented 3 years ago

Thank you so much again! I need to re-read the documents few more times in order to understand how to use Javinzer's many great features. You have done a great job and Javinizer is the best in its class!

beginner0 commented 3 years ago

I have tried my best to figure out how to use Javinizer to scrape javbus for two test files in a folder, but I am unable to understand why Javinizer only graps part of the [ID] string as in the file names:

These are two test files in 'G:\testin' folder:

071714-645.mp4 012413-001.mp4

I turned off all scrapers and only leave javbus on in the settings file

I then Javinizer -path 'g:\testin'

but Javinizer only sees [-645] for [071714-645] and [-100] for [012413-001]

SNAG-1-26-2021 92

What had I done wrong?

jvlflame commented 3 years ago

I then Javinizer -path 'g:\testin'

but Javinizer only sees [-645] for [071714-645] and [-100] for [012413-001]

SNAG-1-26-2021 92

What had I done wrong?

Try Javinizer -Path 'g:\testin' -Strict. Javinizer currently tries to clean filenames for standard DVD IDs so it's erroneously culling the numbers at the start of the filename. -Strict bypasses the file cleaning and uses the exact filename.

beginner0 commented 3 years ago

Thank you! That worked!

beginner0 commented 3 years ago

Javinizer only scrapes Caribbeancom.com movies metadata from javbus, is there a way to scrape the caribbeancompr.com movies metadata too?

jvlflame commented 3 years ago

Javinizer only scrapes Caribbeancom.com movies metadata from javbus, is there a way to scrape the caribbeancompr.com movies metadata too?

Unless they're on AVEntertainments, then no.

beginner0 commented 3 years ago

Thank you!

I want to set nested folders for outputs like "C:\ACTORS\ID\ ",

in settings I set "sort.format.outputfolder": "<ACTORS>\\<ID>",

but it doesn't create nested folders, only one level folder that joins [ACTORS] and [ID] together, how do I set nested folders?

jvlflame commented 3 years ago

Thank you!

I want to set nested folders for outputs like "C:\ACTORS\ID\ ",

in settings I set "sort.format.outputfolder": "<ACTORS>\\<ID>",

but it doesn't create nested folders, only one level folder that joins [ACTORS] and [ID] together, how do I set nested folders?

https://docs.jvlflame.net/configuration/output-folder-structure

You need to do ["<ACTORS>", "<ID>"]