Beta Scanner - Issues (Scanner Hang)

[sven-7]

Not really sure how to log this, but here is what I experienced:

Using latest Beta HAMA as well.

• Slow scanning/hang. Scanner would hang immediately after starting. It looks like in the Plex scan logs, it hands when it finds a "doesn't exist, can't skip" despite that it is there and does exist. A Plex dance on the show that it says might resolve the issue, it might not. If I switch to the master branch, this issue does not exist. Switching the scanner seems to make this issue come up.

For example. it will hit:

Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Green Green"
Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Grimgar of Fantasy and Ash"
Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Guilty Crown"
Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Gun Frontier"
Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Gundam Build Fighters"
Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Gundam Reconguista in G"
Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Gundam-san"
Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Gungrave"
Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Gunparade March"
Feb 19, 2018 09:01:39.472 [9504] DEBUG - Adding subdirectory for scanner: "E:\Series\Gurren Lagan"
Feb 19, 2018 09:01:39.473 [9504] DEBUG - Adding file for scanner: "E:\Series\X-Plex-Token.id"
Feb 19, 2018 09:01:39.476 [9504] DEBUG - File 'E:\Series\Gangsta\Gangsta. - 01 - Naughty Boys.mkv' didn't exist, can't skip.
Feb 19, 2018 09:03:29.677 [9504] DEBUG -       * Scanning 07-Ghost Season 1 Episode 1
Feb 19, 2018 09:03:29.677 [9504] DEBUG - Looking for path match for [E:\Series\07-Ghost\07-Ghost - 1 - The Future of Painful Thoughts is.mkv]
Feb 19, 2018 09:03:29.679 [9504] DEBUG - Path matched, we're reusing media item 164350
Feb 19, 2018 09:03:29.688 [9504] DEBUG -       * Scanning 07-Ghost Season 1 Episode 10

You can see all activity stops for about two minutes. If I Plex dance Gangtsa, then another show takes it's place. All of the files it suggests do not exist, are present.

Update Note: while it is hung, it does appear during that time the individual logs are generating, but it still looks like nothing is happening. The scan wheel on Plex is just spinning. It seems like Plex will scan a bit, then generate logs, then start again. A total scan takes around 10 minutes at times.

logs.zip

--- Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/55226664-beta-scanner-issues-scanner-hang?utm_campaign=plugin&utm_content=tracker%2F3327432&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F3327432&utm_medium=issues&utm_source=github).

[ZeroQI]

Thank you, you honestly helped, have been at it since 5am... This one was a pain to write for, since:

• there is no documentation on scanner behaviour
• errors rarely give the line just stay the scanner had an error which is annoying as hell
• i want grouping folders with plex caching which i didn't though possible... until now :D

So in short, great news and thanks again!

FYI, i just released now a HAMA version which will create agent logs in agent data folders with the same name as the scanner, in a folder with the library name IF you the agent can access library XML (on my Synology NAS but not on Windows) unless you create the .../Plex Media Server/X-Plex-Token.id file with the token inside.

Have a look at the logs in Plex Media Server\Plug-in Support\Data\com.plexapp.agents.hama\DataItems_Logs, they look really good, names are like:

• Darling in the FranXX.filelist.log
• Darling in the FranXX.scanner.log
• Darling in the FranXX.agent-search.log
• Darling in the FranXX.agent-update.log

That should help troubleshooting greatly and also list the filename in plex usual agent log I can now add grouping folders as collection, probably with a "Local" Metadata source

Do you have a wish list for collection field, like how it should behave ? Please let me know any issues

[sven-7]

The current version of the scanner and the new HAMA are working really well. I like the new logging.

I can't think of anything specific for the collections. I did some custom collections when Plex updated how they did it a few weeks ago, but nothing much since. I'll look into it some.

[ZeroQI]

@sven-7 Thanks for this message, i am very happy to ear that

I noticed searches even when restarting the agent were very fast so much better. If no more issues are present might integrate the code as master branch

I did some further coding, and the Prefs verification function now check quite more for errors and indicate changes towards the default settings

Here is the development axis for now

• Grouping folders to go directly in a collection now that you can tell libraries to hide series in a collection, and with the hiding if a single season only, the movies in series libraries look so much better. This will be through a Local.py source.
• TVDB v2 api in progress, will support multiple languages for episodes so the language selection works as it should. right now, only works if selecting anidb as source first. The language of text will be as always the language of the library.
• Pending api key from TrailerAddicts
• Planning maybe a NFO file loader in Local.py source if people wanted a local database. https://kodi.wiki/view/NFO_files should i just support XBMC file format and also allow to generate them in series folder maybe? What do you think?

[ZeroQI]

Pushed Hama code, created a collection if using grouping folders like 'Dragon Ball Series/Dragon Ball Super When creating/editing the library:

• Collections: 'Hide items which are in collections'
• Seasons: 'Hide for single-seasons series' This way you see collections with series inside and no season folders if movies or single season series

[sven-7]

Nice, that's good to know. I'll grab the latest for both today and check it out.

[ZeroQI]

Have re-written AnimeLists, will gather more info that before, and to prepare for true bidirectionnal mapping lists. will allow with thetvdbguids to download the relevant anidb xml and map all like it should, but that's tricky since the xml was built to have one anidb serie mapped to tvdb, the other way around is a nightmare

[sven-7]

That will be pretty interesting. If I'm not mistaken, before for a show like Sword Art Online, it would map the TVDBID to AniDB (a8692) which is season 1, but not season 2 which is AniDB (a10376), right?

[ZeroQI]

Correct. If using multiple season it map back tvdb to anidb but 1 season. Tried to hack to make it multiple seasons without specials but failed... Also coding after tvdbv2 api and will download titles in multiple languages so the agent behave like it should... However it will only download the anidb XML needed... Hopefully people speaking other languages will appreciate true language order working as designed

[ZeroQI]

@sven-7 latest update was meant to solve that. it now loads multiple anidb xmls for tvdb numbered (tvdbid or season>=2). if doesn't work please give me the file and folder names so i can reproduce Let's close that bug report as it's too long and agent related now Please open a new one if anything to report, thanks