evilhero / mylar

An automated Comic Book downloader (cbr/cbz) for use with SABnzbd, NZBGet and torrents
GNU General Public License v3.0
977 stars 172 forks source link

Post-processing freezing in sabnzbd #2353

Closed professionaltart closed 4 years ago

professionaltart commented 4 years ago

Describe the bug I haven't found a way to repro the bug, in part because I have no real idea what's causing it. Sometimes I add a few hundred comics to my wanted list (backfills) and it processes fine, sometimes a random file in that list (can also be single issues added as part of new week releases) will cause the problem: SAB is stuck on processing the comic.

Sometimes this can be resolved by manually copying the file from it's temp download location to where mylar stores things, deleting the empty folder, and restarting the services. Sometimes I need to restart the PC.

Sometimes the folder for the download is empty and it is stuck (I think), but mostly, the folder is there and the file is there. Sometimes the comic has not been moved to the PP destination, mostly it already has been.

This has been an ongoing issue for at least the past few months.

A common occurrence is that after restarting sab a few times, it 'forgets' the location of the scripts folder: reading orphaned items back to the queue will mark them fairly quickly as 'successful', and is one workaround, but then I have to go and sort those few hundred comics into folders manually (I've tried to do manual processing within mylar and it no longer seems to work). Pointing sab back to the correct scripts folder enables post-processing again. It may work fine, it may error and become stuck again on a different file.

Screenshots/Logs Annotation 2019-09-23 153645

mylar pp error log excerpt.txt sab pp error log excerpt.txt

Environment (please complete the following information): OS: Win10 Mylar Version: development -- git build 57b595e9b1ba6e0603f05178f2106338952a0564. Python Version : 2.7.16 Language : en_AU.cp1252

sab Version: Version: | 2.3.9 [03c10dc]

Mylar and sabnzbd are both being run as services

professionaltart commented 4 years ago

I just realised I was 44 commits behind. Updated, now running on:

Mylar Version: development -- git build 9fb9ab4d732fad1c181df54e419975e5ec823d2a.

professionaltart commented 4 years ago

Readded a few hundred comics to the queue and it's PPing them all. Some are a bit slow but it gets there. Can see Mylar actually updating and doing things in the log screen, rather than just stalling, too.

Inpacchi commented 4 years ago

One of the biggest issues with Mylar is that when an error is encountered during a search, post-processing or otherwise, Mylar does not exit the error correctly. So what happens, is that the search queue stays locked instead of catching the error and unlocking the search queue.

This is significant to know because if the search queue locks, even if you had other items that only needed pp-ing, nothing will get processed through Mylar as the whole application has effectively frozen and the only way to resolve it is by doing a restart of the application.

Now I know you said you were 44 commits behind and that's probably gonna fix a bunch of your problems, but you can also try out some of the commits I made which addresses the issue of the application not exiting errors properly. It's been working well for me thus far and allowed me to download over 1,000 issues without a hitch.

professionaltart commented 4 years ago

2019-09-23 16:50:29 ERROR Uncaught exception: Traceback (most recent call last): File "c:\ProgramData\mylar\mylar\logger.py", line 337, in new_run old_run(*args, **kwargs) File "c:\Python27\lib\threading.py", line 754, in run self.__target(*self.__args, **self.__kwargs) File "c:\ProgramData\mylar\mylar\PostProcessor.py", line 403, in Process filelist = flc.listFiles() File "c:\ProgramData\mylar\mylar\filechecker.py", line 137, in listFiles filelist = self.traverse_directories(self.dir) File "c:\ProgramData\mylar\mylar\filechecker.py", line 1402, in traverse_directories comicsize = os.path.getsize(os.path.join(dir, direc, fname)) File "c:\Python27\lib\genericpath.py", line 57, in getsize return os.stat(filename).st_size WindowsError: [Error 3] The system cannot find the path specified: 'E:\\Usenet\\mylar\\X-Men.-.The.Exterminated.001.Mico.Suayan.Fantastic.Four.Villains.Variant.2018.cover.only.Digital.PeteThePIPster-Novus\\X-Men - The Exterminated 001 Mico Suayan Fantastic Four Villains Variant (201 cover only)(Digital)(PeteThePIPster-Novus).cbz' 2019-09-23 16:50:29 INFO Starting postprocessing for : Manual Run

Manually cleaning up the dump folder seems to have gone smoothly once I manually moved a few titles that were blocking, as per above. Is there an issue with long path or file names? That was the only common theme I saw with the blocks.

evilhero commented 4 years ago

@ivtechboyinpa, just wanted to point out that mylar has seperate queues for each of those processes (post-process, search, download) - so if one does fail the others still work. However if it's something like the parser that's shared amongst everything then it will in fact hit the same error multiple times which would then lock each of the queues up.

A "traceback" error is a unhandled exception that mylar was not expecting. This is why when it occurs, it locks the queue up as it was unexpected.

@professionaltart have you tried using completed download handling (CDH) in lieu of the comicrn script?

The comicrn script is very outdated and has some inherit problems with using it. CDH has numerous benefits (and it won't lock up your sabnzbd instance on a failed comicrn run either since it doesn't call any scripts)

Inpacchi commented 4 years ago

@ivtechboyinpa, just wanted to point out that mylar has seperate queues for each of those processes (post-process, search, download) - so if one does fail the others still work. However if it's something like the parser that's shared amongst everything then it will in fact hit the same error multiple times which would then lock each of the queues up.

A "traceback" error is a unhandled exception that mylar was not expecting. This is why when it occurs, it locks the queue up as it was unexpected.

Thanks for that tidbit, good to know and I'll keep it in mind when I encounter an error next!

professionaltart commented 4 years ago

@professionaltart have you tried using completed download handling (CDH) in lieu of the comicrn script?

The comicrn script is very outdated and has some inherit problems with using it. CDH has numerous benefits (and it won't lock up your sabnzbd instance on a failed comicrn run either since it doesn't call any scripts)

I haven't, sorry: I'm just trying to read up a little on it now, and I'll give it a go.

Is there a preferred way to have it set up? I disabled scripts for 'comics' in sab, enabled CDH, and they're sitting in a folder unprocessed for now.

professionaltart commented 4 years ago

@evilhero I think I've read about as much pertinent forum threads as I could find (CDH is searchable, completed download handling refuses, hah).

I saw the pull req @ivtechboyinpa made, which looks like it'd resolve the long name problem I had. When I deleted all the dirs with very long names, manual PP worked without a hitch.

I just at this point am stuck getting CDH working properly.

The python PP script in sab is disabled. CDH and PP are enabled in mylar. I've restarted SAB and Mylar both.
Mylar sends nzbs via hydra2 to sab, which downloads them via the comics category into a /mylar dir. At this point, similar I assume to sonarr and etc which I also have running CDH, sab should then tell mylar that it's complete and to do it's thing. The problem seems to be it's not doing that part. Even with verbose/debug logging enabled, when I let files finish downloading in sab, and they're marked as completed, nothing appears in the mylar logs.

I'm not familiar enough with the programs to know what's causing that break in communication, unfortunately.

professionaltart commented 4 years ago

03-Nov-2019 02:51:22 - INFO :: mylar.clearLogs.3999 : CP Server Thread-6 : Web logs cleared 03-Nov-2019 02:51:24 - INFO :: mylar.toggleVerbose.4017 : CP Server Thread-3 : Verbose (DEBUG) logging is enabled 03-Nov-2019 02:51:24 - DEBUG :: mylar.toggleVerbose.4018 : CP Server Thread-3 : If you can read this message, debug logging is now working 03-Nov-2019 02:51:48 - DEBUG :: mylar.queueissue.1341 : Thread-111 : ComicID: 118281 03-Nov-2019 02:51:48 - DEBUG :: mylar.queueissue.1342 : Thread-111 : mode: want 03-Nov-2019 02:51:48 - INFO :: mylar.queueissue.1432 : Thread-111 : Initiating manual search for War of the Realms: Journey Into Mystery issue: 1 03-Nov-2019 02:51:48 - INFO :: mylar.queueissue.1475 : Thread-111 : [WANTED-SEARCH] Now Queueing War of the Realms: Journey Into Mystery (2019) #1 for search 03-Nov-2019 02:52:13 - DEBUG :: mylar.markissues.1069 : CP Server Thread-6 : Marking 705938 as Skipped 03-Nov-2019 02:52:13 - DEBUG :: mylar.markissues.1083 : CP Server Thread-6 : updated...to Skipped 03-Nov-2019 02:52:19 - DEBUG :: mylar.markissues.1066 : CP Server Thread-3 : Marking War of the Realms: Journey Into Mystery 1 as Wanted 03-Nov-2019 02:52:19 - DEBUG :: mylar.markissues.1083 : CP Server Thread-3 : updated...to Wanted 03-Nov-2019 02:52:19 - DEBUG :: mylar.markissues.1089 : CP Server Thread-3 : Marking issues: ['705938'] as Wanted 03-Nov-2019 02:52:19 - INFO :: mylar.searchIssueIDList.1884 : Thread-112 : searching for issueid: 705938 03-Nov-2019 02:52:19 - INFO :: mylar.search_init.47 : Thread-112 : [SEARCH] Special Characters exist within Series Title. Enabling search-safe Name : War of the Realms Journey Into Mystery 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.63 : Thread-112 : Publisher is : Marvel 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.71 : Thread-112 : Issue Title given as : chapter one: with the will to protect 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.102 : Thread-112 : Checking for torrent enabled. 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.153 : Thread-112 : nzbprovider(s): [u'newznab: nzbHydra2'] 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.156 : Thread-112 : There are 0 torrent providers you have selected. 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.161 : Thread-112 : There are : 1 nzb providers you have selected 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.163 : Thread-112 : Usenet Retention : 4000 days 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.180 : Thread-112 : search provider order is [u'newznab: nzbHydra2'] 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.247 : Thread-112 : calpha/cnumber: None / None 03-Nov-2019 02:52:19 - DEBUG :: mylar.search_init.283 : Thread-112 : Initiating Search via : api 03-Nov-2019 02:52:19 - DEBUG :: mylar.NZB_SEARCH.486 : Thread-112 : Using Newznab host of : nzbHydra2 03-Nov-2019 02:52:19 - INFO :: mylar.NZB_SEARCH.513 : Thread-112 : Shhh be very quiet...I'm looking for War of the Realms: Journey Into Mystery issue: 1 (2019) using nzbHydra2 (newznab). 03-Nov-2019 02:52:19 - DEBUG :: mylar.NZB_SEARCH.577 : Thread-112 : findloop: 0 / findcount: 1 03-Nov-2019 02:52:19 - INFO :: mylar.NZB_SEARCH.733 : Thread-112 : Pausing for 60 seconds before continuing to avoid hammering 03-Nov-2019 02:52:19 - DEBUG :: mylar.NZB_SEARCH.751 : Thread-112 : [SSL: False] Search URL: http://localhost:5076/hydra/api?t=search&q=war%20of%20realms%20journey%20into%20mystery%20001&o=xml&cat=7030&apikey=xUDONTNEEDTOKNOWTHISx 03-Nov-2019 02:52:24 - INFO :: mylar.NZB_SEARCH.805 : Thread-112 : no errors on data retrieval...proceeding 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.846 : Thread-112 : checking search result: War.of.the.Realms-Journey.Into.Mystery.005.2019.Digital.Zone-Empire 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.856 : Thread-112 : sub: War.of.the.Realms-Journey.Into.Mystery.005.2019.Digital.Zone-Empire 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.905 : Thread-112 : comsize_b: 43294000 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.942 : Thread-112 : size given as: 41.3 MB 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.947 : Thread-112 : comparing Min threshold 5242880 .. to .. nzb 43294000 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.988 : Thread-112 : store date used is : 2019-04-10 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.989 : Thread-112 : date used is : 2019-04-10 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.1032 : Thread-112 : usedate: 2019-04-10 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.1078 : Thread-112 : [CONV] Wed, 19 Jun 2019 21:00:22 +0000 is after store date of 2019-04-10 03-Nov-2019 02:52:24 - DEBUG :: mylar.NZB_SEARCH.1098 : Thread-112 : Entry: War.of.the.Realms-Journey.Into.Mystery.005.2019.Digital.Zone-Empire 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.325 : Thread-112 : Improperly formatted filename - there is no seperation using appropriate characters between wording. 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.328 : Thread-112 : NEW split_file3: [u'War', u'of', u'the', u'Realms-Journey', u'Into', u'Mystery', u'005', u'2019', u'Digital', u'Zone-Empire'] 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.360 : Thread-112 : checking now: the 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.394 : Thread-112 : NEWLY SPLIT REORGD: [u'War', u'of', u'the', u'Realms-Journey', u'Into', u'Mystery', u'005', u'2019', u'Digital', u'Zone-Empire'] 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.429 : Thread-112 : checking date : 2019 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.432 : Thread-112 : date: 2019 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.762 : Thread-112 : datecheck: [{'date': u'2019', 'position': 7, 'mod_position': 43}] 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.768 : Thread-112 : sctd: 2019 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.777 : Thread-112 : year verified as : 2019 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.783 : Thread-112 : year verified as: 2019 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.815 : Thread-112 : highest_series_position: 7 03-Nov-2019 02:52:24 - DEBUG :: mylar.parseit.820 : Thread-112 : possible_issuenumbers: [{'position': 6, 'validcountchk': False, 'number': u'005', 'mod_position': 39}, {'position': 7, 'validcountchk': False, 'number': u'2019', 'mod_position': 43}] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.826 : Thread-112 : hyphen located at position: 17 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.828 : Thread-112 : yearposition: 7 03-Nov-2019 02:52:25 - INFO :: mylar.parseit.859 : Thread-112 : Already validated year, ignoring as possible issue number: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.868 : Thread-112 : issue number :005 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.897 : Thread-112 : issue_position: 6 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.914 : Thread-112 : issue verified as : 005 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1041 : Thread-112 : sf_highest_series_pos: [u'War', u'of', u'the', u'Realms-Journey', u'Into', u'Mystery'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1086 : Thread-112 : series title possibly: War of the Realms-Journey Into Mystery 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1115 : Thread-112 : parsed_info: {'series_volume': None, 'booktype': 'issue', 'issueid': None, 'sub': None, 'comiclocation': None, 'reading_order': None, 'parse_status': 'success', 'dynamic_name': u'Warof|Realms|JourneyIntoMystery', 'series_name': u'War of the Realms-Journey Into Mystery', 'comicfilename': u'War.of.the.Realms-Journey.Into.Mystery.005.2019.Digital.Zone-Empire', 'issue_number': u'005', 'issue_year': '2019', 'scangroup': None, 'alt_series': None, 'alt_issue': None, 'series_name_decoded': 'War of the Realms-Journey Into Mystery'} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1124 : Thread-112 : match_check: {'justthedigits': u'005', 'issueid': None, 'match_type': None, 'sub': None, 'comiclocation': None, 'booktype': 'issue', 'series_name': u'War of the Realms-Journey Into Mystery', 'comicfilename': u'War.of.the.Realms-Journey.Into.Mystery.005.2019.Digital.Zone-Empire', 'annual_comicid': None, 'issue_year': '2019', 'volume': None, 'process_status': 'match', 'scangroup': None, 'alt_series': None, 'alt_issue': None, 'series_volume': None} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1184 : Thread-112 : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1370 : Thread-112 : issue we are looking for is : 1 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1371 : Thread-112 : integer value of issue we are looking for : 1000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1378 : Thread-112 : issue we found for is : 005 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1380 : Thread-112 : integer value of issue we have found : 5000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.846 : Thread-112 : checking search result: War.of.the.Realms-Journey.Into.Mystery.004.2019.Digital.Zone-Empire 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.856 : Thread-112 : sub: War.of.the.Realms-Journey.Into.Mystery.004.2019.Digital.Zone-Empire 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.905 : Thread-112 : comsize_b: 37404000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.942 : Thread-112 : size given as: 35.7 MB 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.947 : Thread-112 : comparing Min threshold 5242880 .. to .. nzb 37404000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.988 : Thread-112 : store date used is : 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.989 : Thread-112 : date used is : 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1032 : Thread-112 : usedate: 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1078 : Thread-112 : [CONV] Wed, 05 Jun 2019 20:44:33 +0000 is after store date of 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1098 : Thread-112 : Entry: War.of.the.Realms-Journey.Into.Mystery.004.2019.Digital.Zone-Empire 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.325 : Thread-112 : Improperly formatted filename - there is no seperation using appropriate characters between wording. 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.328 : Thread-112 : NEW split_file3: [u'War', u'of', u'the', u'Realms-Journey', u'Into', u'Mystery', u'004', u'2019', u'Digital', u'Zone-Empire'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.360 : Thread-112 : checking now: the 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.394 : Thread-112 : NEWLY SPLIT REORGD: [u'War', u'of', u'the', u'Realms-Journey', u'Into', u'Mystery', u'004', u'2019', u'Digital', u'Zone-Empire'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.429 : Thread-112 : checking date : 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.432 : Thread-112 : date: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.762 : Thread-112 : datecheck: [{'date': u'2019', 'position': 7, 'mod_position': 43}] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.768 : Thread-112 : sctd: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.777 : Thread-112 : year verified as : 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.783 : Thread-112 : year verified as: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.815 : Thread-112 : highest_series_position: 7 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.820 : Thread-112 : possible_issuenumbers: [{'position': 6, 'validcountchk': False, 'number': u'004', 'mod_position': 39}, {'position': 7, 'validcountchk': False, 'number': u'2019', 'mod_position': 43}] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.826 : Thread-112 : hyphen located at position: 17 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.828 : Thread-112 : yearposition: 7 03-Nov-2019 02:52:25 - INFO :: mylar.parseit.859 : Thread-112 : Already validated year, ignoring as possible issue number: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.868 : Thread-112 : issue number :004 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.897 : Thread-112 : issue_position: 6 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.914 : Thread-112 : issue verified as : 004 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1041 : Thread-112 : sf_highest_series_pos: [u'War', u'of', u'the', u'Realms-Journey', u'Into', u'Mystery'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1086 : Thread-112 : series title possibly: War of the Realms-Journey Into Mystery 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1115 : Thread-112 : parsed_info: {'series_volume': None, 'booktype': 'issue', 'issueid': None, 'sub': None, 'comiclocation': None, 'reading_order': None, 'parse_status': 'success', 'dynamic_name': u'Warof|Realms|JourneyIntoMystery', 'series_name': u'War of the Realms-Journey Into Mystery', 'comicfilename': u'War.of.the.Realms-Journey.Into.Mystery.004.2019.Digital.Zone-Empire', 'issue_number': u'004', 'issue_year': '2019', 'scangroup': None, 'alt_series': None, 'alt_issue': None, 'series_name_decoded': 'War of the Realms-Journey Into Mystery'} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1124 : Thread-112 : match_check: {'justthedigits': u'004', 'issueid': None, 'match_type': None, 'sub': None, 'comiclocation': None, 'booktype': 'issue', 'series_name': u'War of the Realms-Journey Into Mystery', 'comicfilename': u'War.of.the.Realms-Journey.Into.Mystery.004.2019.Digital.Zone-Empire', 'annual_comicid': None, 'issue_year': '2019', 'volume': None, 'process_status': 'match', 'scangroup': None, 'alt_series': None, 'alt_issue': None, 'series_volume': None} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1184 : Thread-112 : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1370 : Thread-112 : issue we are looking for is : 1 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1371 : Thread-112 : integer value of issue we are looking for : 1000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1378 : Thread-112 : issue we found for is : 004 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1380 : Thread-112 : integer value of issue we have found : 4000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.846 : Thread-112 : checking search result: War.Of.The.Realms-Journey.Into.Mystery.03.of.05.2019.Oroboros-DCP 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.856 : Thread-112 : sub: War.Of.The.Realms-Journey.Into.Mystery.03.of.05.2019.Oroboros-DCP 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.905 : Thread-112 : comsize_b: 45048000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.942 : Thread-112 : size given as: 43.0 MB 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.947 : Thread-112 : comparing Min threshold 5242880 .. to .. nzb 45048000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.988 : Thread-112 : store date used is : 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.989 : Thread-112 : date used is : 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1032 : Thread-112 : usedate: 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1078 : Thread-112 : [CONV] Thu, 23 May 2019 07:29:17 +0000 is after store date of 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1098 : Thread-112 : Entry: War.Of.The.Realms-Journey.Into.Mystery.03.of.05.2019.Oroboros-DCP 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.325 : Thread-112 : Improperly formatted filename - there is no seperation using appropriate characters between wording. 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.328 : Thread-112 : NEW split_file3: [u'War', u'Of', u'The', u'Realms-Journey', u'Into', u'Mystery', u'03', u'of', u'05', u'2019', u'Oroboros-DCP'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.360 : Thread-112 : checking now: 05 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.364 : Thread-112 : [MINI-SERIES] MAX ISSUES IN SERIES: 05 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.394 : Thread-112 : NEWLY SPLIT REORGD: [u'War', u'Of', u'The', u'Realms-Journey', u'Into', u'Mystery', u'03', u'of', u'(of 05)', u'2019', u'Oroboros-DCP'] 03-Nov-2019 02:52:25 - INFO :: mylar.parseit.719 : Thread-112 : MINI-SERIES DETECTED 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.504 : Thread-112 : Mini-Series Count detected. Maximum issue # set to : 5 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.507 : Thread-112 : Issue Number SHOULD BE: 03 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.429 : Thread-112 : checking date : 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.432 : Thread-112 : date: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.762 : Thread-112 : datecheck: [{'date': u'2019', 'position': 9, 'mod_position': -1}] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.768 : Thread-112 : sctd: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.777 : Thread-112 : year verified as : 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.783 : Thread-112 : year verified as: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.815 : Thread-112 : highest_series_position: 9 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.820 : Thread-112 : possible_issuenumbers: [{'position': 6, 'validcountchk': False, 'number': u'03', 'mod_position': 39}, {'position': 9, 'validcountchk': True, 'number': u'2019', 'mod_position': -1}] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.826 : Thread-112 : hyphen located at position: 17 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.828 : Thread-112 : yearposition: 9 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.847 : Thread-112 : Issue verified and detected as part of a numeric count sequnce: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.897 : Thread-112 : issue_position: 9 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.914 : Thread-112 : issue verified as : 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1041 : Thread-112 : sf_highest_series_pos: [u'War', u'Of', u'The', u'Realms-Journey', u'Into', u'Mystery', u'03', u'of', u'(of 05)'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1086 : Thread-112 : series title possibly: War Of The Realms-Journey Into Mystery 03 of (of 05) 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1115 : Thread-112 : parsed_info: {'series_volume': None, 'booktype': 'issue', 'issueid': None, 'sub': None, 'comiclocation': None, 'reading_order': None, 'parse_status': 'success', 'dynamic_name': u'WarOf|Realms|JourneyIntoMystery03of|of05', 'series_name': u'War Of The Realms-Journey Into Mystery 03 of (of 05)', 'comicfilename': u'War.Of.The.Realms-Journey.Into.Mystery.03.of.05.2019.Oroboros-DCP', 'issue_number': u'2019', 'issue_year': '2019', 'scangroup': None, 'alt_series': None, 'alt_issue': None, 'series_name_decoded': 'War Of The Realms-Journey Into Mystery 03 of (of 05)'} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1124 : Thread-112 : match_check: {'series_volume': None, 'issue_year': '2019', 'comiclocation': None, 'series_name': u'War Of The Realms-Journey Into Mystery 03 of (of 05)', 'scangroup': None, 'alt_series': None, 'issueid': None, 'sub': None, 'booktype': 'issue', 'comicfilename': u'War.Of.The.Realms-Journey.Into.Mystery.03.of.05.2019.Oroboros-DCP', 'issue_number': u'2019', 'process_status': 'fail', 'alt_issue': None} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1184 : Thread-112 : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.846 : Thread-112 : checking search result: War.of.the.Realms-Journey.Into.Mystery.002.2019.Digital.Zone-Empire 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.856 : Thread-112 : sub: War.of.the.Realms-Journey.Into.Mystery.002.2019.Digital.Zone-Empire 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.905 : Thread-112 : comsize_b: 40649000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.942 : Thread-112 : size given as: 38.8 MB 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.947 : Thread-112 : comparing Min threshold 5242880 .. to .. nzb 40649000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.988 : Thread-112 : store date used is : 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.989 : Thread-112 : date used is : 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1032 : Thread-112 : usedate: 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1078 : Thread-112 : [CONV] Wed, 08 May 2019 23:50:00 +0000 is after store date of 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1098 : Thread-112 : Entry: War.of.the.Realms-Journey.Into.Mystery.002.2019.Digital.Zone-Empire 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.325 : Thread-112 : Improperly formatted filename - there is no seperation using appropriate characters between wording. 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.328 : Thread-112 : NEW split_file3: [u'War', u'of', u'the', u'Realms-Journey', u'Into', u'Mystery', u'002', u'2019', u'Digital', u'Zone-Empire'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.360 : Thread-112 : checking now: the 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.394 : Thread-112 : NEWLY SPLIT REORGD: [u'War', u'of', u'the', u'Realms-Journey', u'Into', u'Mystery', u'002', u'2019', u'Digital', u'Zone-Empire'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.429 : Thread-112 : checking date : 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.432 : Thread-112 : date: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.762 : Thread-112 : datecheck: [{'date': u'2019', 'position': 7, 'mod_position': 43}] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.768 : Thread-112 : sctd: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.777 : Thread-112 : year verified as : 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.783 : Thread-112 : year verified as: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.815 : Thread-112 : highest_series_position: 7 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.820 : Thread-112 : possible_issuenumbers: [{'position': 6, 'validcountchk': False, 'number': u'002', 'mod_position': 39}, {'position': 7, 'validcountchk': False, 'number': u'2019', 'mod_position': 43}] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.826 : Thread-112 : hyphen located at position: 17 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.828 : Thread-112 : yearposition: 7 03-Nov-2019 02:52:25 - INFO :: mylar.parseit.859 : Thread-112 : Already validated year, ignoring as possible issue number: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.868 : Thread-112 : issue number :002 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.897 : Thread-112 : issue_position: 6 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.914 : Thread-112 : issue verified as : 002 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1041 : Thread-112 : sf_highest_series_pos: [u'War', u'of', u'the', u'Realms-Journey', u'Into', u'Mystery'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1086 : Thread-112 : series title possibly: War of the Realms-Journey Into Mystery 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1115 : Thread-112 : parsed_info: {'series_volume': None, 'booktype': 'issue', 'issueid': None, 'sub': None, 'comiclocation': None, 'reading_order': None, 'parse_status': 'success', 'dynamic_name': u'Warof|Realms|JourneyIntoMystery', 'series_name': u'War of the Realms-Journey Into Mystery', 'comicfilename': u'War.of.the.Realms-Journey.Into.Mystery.002.2019.Digital.Zone-Empire', 'issue_number': u'002', 'issue_year': '2019', 'scangroup': None, 'alt_series': None, 'alt_issue': None, 'series_name_decoded': 'War of the Realms-Journey Into Mystery'} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1124 : Thread-112 : match_check: {'justthedigits': u'002', 'issueid': None, 'match_type': None, 'sub': None, 'comiclocation': None, 'booktype': 'issue', 'series_name': u'War of the Realms-Journey Into Mystery', 'comicfilename': u'War.of.the.Realms-Journey.Into.Mystery.002.2019.Digital.Zone-Empire', 'annual_comicid': None, 'issue_year': '2019', 'volume': None, 'process_status': 'match', 'scangroup': None, 'alt_series': None, 'alt_issue': None, 'series_volume': None} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1184 : Thread-112 : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1370 : Thread-112 : issue we are looking for is : 1 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1371 : Thread-112 : integer value of issue we are looking for : 1000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1378 : Thread-112 : issue we found for is : 002 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1380 : Thread-112 : integer value of issue we have found : 2000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.846 : Thread-112 : checking search result: War Of The Realms - Journey Into Mystery 01 (of 05) (2019) (Oroboros-DCP) 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.856 : Thread-112 : sub: War Of The Realms - Journey Into Mystery 01 (of 05) (2019) (Oroboros-DCP) 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.905 : Thread-112 : comsize_b: 42006000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.942 : Thread-112 : size given as: 40.1 MB 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.947 : Thread-112 : comparing Min threshold 5242880 .. to .. nzb 42006000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.988 : Thread-112 : store date used is : 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.989 : Thread-112 : date used is : 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1032 : Thread-112 : usedate: 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1078 : Thread-112 : [CONV] Thu, 11 Apr 2019 08:31:58 +0000 is after store date of 2019-04-10 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1098 : Thread-112 : Entry: War Of The Realms - Journey Into Mystery 01 (of 05) (2019) (Oroboros-DCP) 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.287 : Thread-112 : Scanner group tag discovered: Oroboros-DCP 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.394 : Thread-112 : NEWLY SPLIT REORGD: [u'War', u'Of', u'The', u'Realms', u'-', u'Journey', u'Into', u'Mystery', u'01', u'(of 05)', u'(2019)'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.504 : Thread-112 : Mini-Series Count detected. Maximum issue # set to : 5 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.507 : Thread-112 : Issue Number SHOULD BE: 01 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.429 : Thread-112 : checking date : 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.432 : Thread-112 : date: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.762 : Thread-112 : datecheck: [{'date': u'2019', 'position': 10, 'mod_position': 52}] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.768 : Thread-112 : sctd: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.777 : Thread-112 : year verified as : 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.783 : Thread-112 : year verified as: 2019 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.815 : Thread-112 : highest_series_position: 10 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.820 : Thread-112 : possible_issuenumbers: [{'position': 8, 'validcountchk': False, 'number': u'01', 'mod_position': 41}] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.826 : Thread-112 : hyphen located at position: 18 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.828 : Thread-112 : yearposition: 10 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.868 : Thread-112 : issue number :01 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.897 : Thread-112 : issue_position: 8 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.914 : Thread-112 : issue verified as : 01 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1025 : Thread-112 : ALT-SERIES NAME [ISSUE TITLE]: War Of The Realms [Journey Into Mystery] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1041 : Thread-112 : sf_highest_series_pos: [u'War', u'Of', u'The', u'Realms', u'-', u'Journey', u'Into', u'Mystery'] 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1086 : Thread-112 : series title possibly: War Of The Realms - Journey Into Mystery 03-Nov-2019 02:52:25 - DEBUG :: mylar.parseit.1099 : Thread-112 : Alternate series / issue title: War Of The Realms [Journey Into Mystery] 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1115 : Thread-112 : parsed_info: {'series_volume': None, 'booktype': 'issue', 'issueid': None, 'sub': None, 'comiclocation': None, 'reading_order': None, 'parse_status': 'success', 'dynamic_name': u'WarOf|Realms|JourneyIntoMystery', 'series_name': u'War Of The Realms - Journey Into Mystery', 'comicfilename': u'War Of The Realms - Journey Into Mystery 01 (of 05) (2019) (Oroboros-DCP)', 'issue_number': u'01', 'issue_year': '2019', 'scangroup': u'Oroboros-DCP', 'alt_series': u'War Of The Realms', 'alt_issue': u'Journey Into Mystery', 'series_name_decoded': 'War Of The Realms - Journey Into Mystery'} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1124 : Thread-112 : match_check: {'justthedigits': u'01', 'issueid': None, 'match_type': None, 'sub': None, 'comiclocation': None, 'booktype': 'issue', 'series_name': u'War Of The Realms - Journey Into Mystery', 'comicfilename': u'War Of The Realms - Journey Into Mystery 01 (of 05) (2019) (Oroboros-DCP)', 'annual_comicid': None, 'issue_year': '2019', 'volume': None, 'process_status': 'match', 'scangroup': u'Oroboros-DCP', 'alt_series': u'War Of The Realms', 'alt_issue': u'Journey Into Mystery', 'series_volume': None} 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1184 : Thread-112 : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1370 : Thread-112 : issue we are looking for is : 1 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1371 : Thread-112 : integer value of issue we are looking for : 1000 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1378 : Thread-112 : issue we found for is : 01 03-Nov-2019 02:52:25 - DEBUG :: mylar.NZB_SEARCH.1380 : Thread-112 : integer value of issue we have found : 1000 03-Nov-2019 02:52:25 - DEBUG :: mylar.nzbname_create.2026 : Thread-112 : [SEARCHER] entry[title]: War Of The Realms - Journey Into Mystery 01 (of 05) (2019) (Oroboros-DCP) 03-Nov-2019 02:52:25 - DEBUG :: mylar.nzbname_create.2031 : Thread-112 : [SEARCHER] nzbname (remove chars): War Of The Realms - Journey Into Mystery 01 of 05 2019 Oroboros-DCP 03-Nov-2019 02:52:25 - DEBUG :: mylar.nzbname_create.2036 : Thread-112 : [SEARCHER] nzbname (\s): War Of The Realms - Journey Into Mystery 01 of 05 2019 Oroboros-DCP 03-Nov-2019 02:52:25 - DEBUG :: mylar.nzbname_create.2043 : Thread-112 : [SEARCHER] end nzbname: War.Of.The.Realms.-.Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP 03-Nov-2019 02:52:25 - DEBUG :: mylar.nzbname_create.2048 : Thread-112 : nzbname used for post-processing: War.Of.The.Realms.-.Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP 03-Nov-2019 02:52:25 - DEBUG :: mylar.searcher.2103 : Thread-112 : issues match! 03-Nov-2019 02:52:25 - INFO :: mylar.searcher.2122 : Thread-112 : Found War of the Realms: Journey Into Mystery (2019) #1 using nzbHydra2 (newznab) 03-Nov-2019 02:52:25 - DEBUG :: mylar.searcher.2124 : Thread-112 : link given by: newznab 03-Nov-2019 02:52:25 - INFO :: mylar.searcher.2127 : Thread-112 : nzbid: -6782784484731072420 03-Nov-2019 02:52:25 - INFO :: mylar.searcher.2128 : Thread-112 : IssueID: 705938 03-Nov-2019 02:52:25 - INFO :: mylar.searcher.2129 : Thread-112 : oneoff: False 03-Nov-2019 02:52:25 - INFO :: mylar.failed_check.250 : Thread-112 : prov : nzbHydra2 (newznab)[-6782784484731072420] 03-Nov-2019 02:52:25 - INFO :: mylar.failed_check.261 : Thread-112 : [FAILED_DOWNLOAD_CHECKER] Successfully marked this download as Good for downloadable content 03-Nov-2019 02:52:25 - DEBUG :: mylar.searcher.2147 : Thread-112 : [FAILED_DOWNLOAD_CHECKER] This is not in the failed downloads list. Will continue with the download. 03-Nov-2019 02:52:25 - DEBUG :: mylar.searcher.2227 : Thread-112 : [PAYLOAD-NONE] Download URL: http://localhost:5076/hydra/getnzb/api/-6782784484731072420?apikey=xYOUDONTNEEDTOKNOWTHISx [VerifySSL: False] 03-Nov-2019 02:52:26 - DEBUG :: mylar.searcher.2247 : Thread-112 : Status code returned: 200 03-Nov-2019 02:52:26 - DEBUG :: mylar.searcher.2269 : Thread-112 : filename within nzb: War.Of.The.Realms-Journey.Into.Mystery.01.(of.05).(2019).(Oroboros-DCP).nzb 03-Nov-2019 02:52:26 - DEBUG :: mylar.searcher.2286 : Thread-112 : [FILENAME] filename (remove chars): War.Of.The.Realms-Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP.nzb 03-Nov-2019 02:52:26 - DEBUG :: mylar.searcher.2289 : Thread-112 : [FILENAME] nzbname (\s): War.Of.The.Realms-Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP.nzb 03-Nov-2019 02:52:26 - DEBUG :: mylar.searcher.2291 : Thread-112 : [FILENAME] end nzbname: War.Of.The.Realms-Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP.nzb 03-Nov-2019 02:52:26 - INFO :: mylar.searcher.2297 : Thread-112 : filen: War.Of.The.Realms-Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP.nzb -- nzbname: War.Of.The.Realms.-.Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP are not identical. Storing extra value as : War.Of.The.Realms-Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP 03-Nov-2019 02:52:26 - DEBUG :: mylar.searcher.2302 : Thread-112 : Cache Directory successfully found at : c:\ProgramData\mylar\cache. Ensuring proper permissions. 03-Nov-2019 02:52:26 - INFO :: mylar.sender.42 : Thread-112 : parameters set to {'nzbname': u'War.Of.The.Realms.-.Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP.nzb', 'apikey': 'f9227647686a977e0d73444221a1501a', 'name': u'http://192.168.2.81:8090/mylar/api?apikey=fc0495619bc3acbeab99948cd5d6f256&cmd=downloadNZB&nzbname=War.Of.The.Realms.-.Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP.nzb', 'cmd': 'downloadNZB', 'cat': 'comics', 'priority': '-100', 'mode': 'addurl', 'output': 'json'} 03-Nov-2019 02:52:26 - INFO :: mylar.sender.43 : Thread-112 : sending now to http://localhost:8080/api 03-Nov-2019 02:52:28 - DEBUG :: mylar.checkParams.113 : CP Server Thread-7 : Matched to key. Api set to : download mode. 03-Nov-2019 02:52:28 - INFO :: mylar.sender.50 : Thread-112 : {u'status': True, u'nzo_ids': [u'SABnzbd_nzo_avjhml']} 03-Nov-2019 02:52:29 - DEBUG :: mylar.fetchData.143 : CP Server Thread-7 : Received API command: downloadNZB 03-Nov-2019 02:52:29 - INFO :: mylar.searcher.2637 : Thread-112 : sendtosab: {'status': True, 'issueid': u'705938', 'apicall': True, 'nzo_id': u'SABnzbd_nzo_avjhml', 'queue': {'output': 'json', 'search': u'SABnzbd_nzo_avjhml', 'apikey': 'f9227647686a977e0d73444221a1501a', 'mode': 'queue'}, 'comicid': u'118281'} 03-Nov-2019 02:52:29 - INFO :: mylar.searcher.2649 : Thread-112 : Successfully sent nzb file to SABnzbd 03-Nov-2019 02:52:29 - INFO :: mylar.NZB_SEARCH.1524 : Thread-112 : mylar.COMICINFO: [{'IssueID': u'705938', 'pack_numbers': None, 'IssueNumber': u'1', 'nzbtitle': u'War Of The Realms - Journey Into Mystery 01 (of 05) (2019) (Oroboros-DCP)', 'nzbid': u'-6782784484731072420', 'size': '40.1 MB', 'newznab': (u'nzbHydra2', u'http://localhost:5076/hydra/', 0, u'40D9LOA14CDAGE85OR4A12A0Q1', u'', '1'), 'ComicName': u'War of the Realms: Journey Into Mystery', 'provider': u'nzbHydra2', 'ComicID': u'118281', 'ComicVolume': None, 'modcomicname': u'War of the Realms: Journey Into Mystery', 'link': u'http://localhost:5076/hydra/getnzb/api/-6782784484731072420?apikey=40D9LOA14CDAGE85OR4A12A0Q1', 'IssueDate': u'2019-06-01', 'kind': 'usenet', 'torznab': None, 'SARC': None, 'oneoff': False, 'pack_issuelist': None, 'IssueArcID': None, 'comyear': '2019', 'nzbprov': 'newznab', 'tmpprov': u'nzbHydra2 (newznab)', 'pack': False}] 03-Nov-2019 02:52:29 - DEBUG :: mylar.NZB_SEARCH.1552 : Thread-112 : Found matching comic...preparing to send to Updater with IssueID: 705938 and nzbname: War.Of.The.Realms.-.Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP [War.Of.The.Realms-Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP] 03-Nov-2019 02:52:29 - INFO :: mylar.nzblog.688 : Thread-112 : setting the nzbid for this download grabbed by nzbHydra2 (newznab) in the nzblog to : -6782784484731072420 03-Nov-2019 02:52:29 - INFO :: mylar.nzblog.692 : Thread-112 : setting the alternate nzbname for this download grabbed by nzbHydra2 (newznab) in the nzblog to : War.Of.The.Realms-Journey.Into.Mystery.01.of.05.2019.Oroboros-DCP 03-Nov-2019 02:52:29 - DEBUG :: mylar.search_init.377 : Thread-112 : findit = found! 03-Nov-2019 02:52:29 - DEBUG :: mylar.foundsearch.723 : Thread-112 : [UPDATER] comicid: 118281 03-Nov-2019 02:52:29 - DEBUG :: mylar.foundsearch.724 : Thread-112 : [UPDATER] issueid: 705938 03-Nov-2019 02:52:29 - INFO :: mylar.foundsearch.757 : Thread-112 : [UPDATER] Updating status to snatched 03-Nov-2019 02:52:29 - DEBUG :: mylar.foundsearch.758 : Thread-112 : [UPDATER] Provider is nzbHydra2 (newznab) 03-Nov-2019 02:52:29 - INFO :: mylar.foundsearch.859 : Thread-112 : [UPDATER] Updated the status (Snatched) complete for War of the Realms: Journey Into Mystery Issue: 1 03-Nov-2019 02:52:29 - INFO :: mylar.searchIssueIDList.1919 : Thread-112 : Completed search request.

Sorry if that's too ugly.

I'm playing with the reading arc stuff, and finding for some I have all the issues, and for some I don't have them all. Hitting the manual search/magnifying glass icon in the arc list didn't pull it straight away, so I clicked through to the series (I manually added all of the various parts of 'War of the Realms' earlier, before I discovered the storyarcs in mylar), and tried manual search again. Still no sign of nzbhydra being hit. I marked the issue as skipped, and then wanted, which manually triggered (I guess?) mylar to search for the issue. It talks to hydra, it finds it, and sends it on to sab to download. And then nothing.

I seem to be running the current dev build, Version: 36f544b6d9455d0f2a4b2eb91ae3a762b558c3de (development)

See attached for what I think are pertinent settings screenshots. mylar settings 1 mylar settings 2 mylar settings 3

evilhero commented 4 years ago

If the search queue encounters an error, of any kind that's not expected (ie. traceback errors usually) it will end the queue entirely. At that point the only way to restart the queue, which usually means restarting Mylar.

The problem with the file in the log is that War.Of.The.Realms-Journey.Into.Mystery isn't being parsed properly by Mylar so that's causing some problems down the chain (where I dunno exactly, but looking at it I can see it is problematic). The reason why is because it's using decimal places as space delimiters, and then throws a dash in there without spacing on either side - so Mylar is assuming that it's one word instead of 2 separate words and the matching is off abit. It still seems to snatch it fine, so at that point I would assume it's because the post-processing queue got locked up due to some traceback error and it needs to get restarted to clear the error.

professionaltart commented 4 years ago

Restarting mylar to restart the queue also seemed to make a python process that sat there overnight using a heap of CPU time stop and start behaving again too, hooray!

I just added an unambiguously short titled comic to test. Clicked on manual download, and it sent it through the chain of hydra, sab, and then automatically PP'd it, presumably using CDH. I've just tried a more ambiguous one - trying to get issue #300 of Uncanny X-men, but it's title in Mylar is 'The' Uncanny X-men. The lack of 'The' in the search results seemed to make it stumble, but adding an alternate search term, sans 'the', made it grab and process and post-process fine, automatically.

So outside of naming convention/parsing issues, this looks like it's wrapped up the PP/CDH issues, thanks!

professionaltart commented 4 years ago

Sort of resolved, anyway. Mostly it works, sometimes it still won't PP. Need to do some testing and see if I can find anything further in logs.

professionaltart commented 4 years ago

mylar.uncanny.inhumans.txt

The filename looks OK to me. Only thing different is this is imported via storyarc, so it's not a series I've added to mylar. My understanding is this should be fine and it'll just store it in, say, /comics/storyarc or something?