search

evilhero / mylar

An automated Comic Book downloader (cbr/cbz) for use with SABnzbd, NZBGet and torrents
GNU General Public License v3.0
977 stars 173 forks source link

PostProcessing Unable to Find Download #136

Closed digiwombat closed 11 years ago

digiwombat commented 11 years ago

Running commit c6d2d296ae4765f7984550327dc4c2f379950f4a and I am getting the following error after a download:

http://i.imgur.com/ru4oA.png

Has happened for every download so far on the newer commits. Copied the new post processing files over to the SABnzbd folder just to be safe even though there were no new commits to those files.

Series this has happened with so far: All New X-Men, Mind the Gap, Invincible

All of those were today after I updated so I am assuming it's a code issue either here or with SABnzbd which I updated last night.

On Windows, Python 2.7.3, SABnzbd version 0.7.8

evilhero commented 11 years ago

Ok, I knew I forgot one provider to test (Experimental)...do you have access to another provider in the meantime? I'll have to look at the code, but not get around to it today.

If you could paste the last few lines from the mylar.log file showing the name of the nzb in post-processing it would help (also the link that SAB is sending back to Mylar)

digiwombat commented 11 years ago

All the relevant log info for the nzb file:

07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : link given by: experimental 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : link: http://nzbindex.nl/download/83142416/0-Day-2013.01.02-All-New-X-Men-005-2013-Digital-Zone-Empire.cbr-32301333-Bytes 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : linkforapi: http://nzbindex.nl/download/83142416/0-Day-2013.01.02-All-New-X-Men-005-2013-Digital-Zone-Empire.cbr-32301333-Bytes 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : cache directory successfully found at : C:\Users\randall\Desktop\SickBeard\omniverse\cache/ 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : link to retrieve via api:http://nzbindex.nl/download/83142416/0-Day-2013.01.02-All-New-X-Men-005-2013-Digital-Zone-Empire.cbr-32301333-Bytes 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : nzbname used for post-processing:All_New_X_Men005(2013)(Digital)(Zone_Empire)_cbr 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : send-to-SAB host string: http://localhost:8080 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : ...selecting API type: http://localhost:8080/api?mode=addurl&name= 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : ...attaching nzb provider link: http://localhost:8080/api?mode=addurl&name=http://nzbindex.nl/download/83142416/0-Day-2013.01.02-All-New-X-Men-005-2013-Digital-Zone-Empire.cbr-32301333-Bytes 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : ...attaching category: http://localhost:8080/api?mode=addurl&name=http://nzbindex.nl/download/83142416/0-Day-2013.01.02-All-New-X-Men-005-2013-Digital-Zone-Empire.cbr-32301333-Bytes&cat=comics 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : ...attaching rename script: http://localhost:8080/api?mode=addurl&name=http://nzbindex.nl/download/83142416/0-Day-2013.01.02-All-New-X-Men-005-2013-Digital-Zone-Empire.cbr-32301333-Bytes&cat=comics&script=ComicRN.py 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : Completed send-to-SAB link: http://localhost:8080/api?mode=addurl&name=http://nzbindex.nl/download/83142416/0-Day-2013.01.02-All-New-X-Men-005-2013-Digital-Zone-Empire.cbr-32301333-Bytes&cat=comics&script=ComicRN.py&apikey=ff162285bfd3fe892bf7e3690cc91323 07-Jan-2013 14:22:05 - INFO :: CP Server Thread-7 : Successfully sent nzb file to SABnzbd 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : we should break out now - sucessful search previous 07-Jan-2013 14:22:05 - DEBUG :: CP Server Thread-7 : Found matching comic...preparing to send to Updater with IssueID: 376661 and nzbname: All_New_X_Men005(2013)(Digital)(Zone_Empire)_cbr 07-Jan-2013 14:22:06 - DEBUG :: CP Server Thread-7 : updating status to snatched 07-Jan-2013 14:22:06 - DEBUG :: CP Server Thread-7 : updating snatched db. 07-Jan-2013 14:22:06 - INFO :: CP Server Thread-7 : Updating now complete for All-New X-Men issue: 5.00 07-Jan-2013 14:22:38 - INFO :: CP Server Thread-3 : Starting postprocessing for : All New X-Men 005 (2013) (Digital) (Zone-Empire).cbr 07-Jan-2013 14:22:38 - INFO :: CP Server Thread-3 : SABnzbd setting: Replace Decimals is disabled. 07-Jan-2013 14:22:38 - INFO :: CP Server Thread-3 : SABnzbd setting: Replace spaces is disabled. 07-Jan-2013 14:22:38 - DEBUG :: CP Server Thread-3 : trying again with this nzbname: All_New_X_Men005(2013)(Digital)(Zone_Empire).cbr 07-Jan-2013 14:22:38 - ERROR :: CP Server Thread-3 : Unable to locate downloaded file to rename. PostProcessing aborted.

Sadly, other than experimental, all I have is a newznab provider that sends back empty nzb files 99% of the time (usenet-crawler) so, I'll look for another one in the mean time. Not a big deal if I have to do a few issues manually. :D

DGMayor commented 11 years ago

Same thing for Batman Unlimited #11 -

Loading config from c:\Program Files (x86)\SABnzbd\scripts\autoProcessComics.cfg Opening URL: http://172.16.61.75:8090/post_process?nzb_name=Batman.Beyond.Unlimited.011.%282013%29%28FB-DCP%29%28C2C%29&nzb_folder=C%3A%5CUsers%5CMe%5CDownloads%5Cnews%5CComplete%5CComics%5CBatman.Beyond.Unlimited.011.%282013%29%28FB-DCP%29%28C2C%29

Not using Experimental.

DGMayor commented 11 years ago

Earth 2 - issue 0 Loading config from c:\Program Files (x86)\SABnzbd\scripts\autoProcessComics.cfg Opening URL: http://172.16.61.75:8090/post_process?nzb_name=Earth.2.000.%282012%29.%28Digital%29.%28Zone-Empire%29&nzb_folder=C%3A%5CUsers%5CMe%5CDownloads%5Cnews%5CComplete%5CComics%5CEarth.2.000.%282012%29.%28Digital%29.%28Zone-Empire%29.1

digiwombat commented 11 years ago

My SABnzbd info looks the same as DGMayor's, since I forgot to post that.

evilhero commented 11 years ago

I know what the problem is and its just from Experimental from the looks of it but I'll do a global change just in case. Mylar stores the name of the nzb without the extension, Experimental is returning the complete filename with extension (as it should its a raw indexer). Its working now for me, so once I'm done making supper for the little heroes I'kl push the comit up.

evilhero commented 11 years ago

DGMayor: crap I forgot about dog replacing spaces with decimals..your nzbname has spaces replaced with dots. I can't confirm atm, but when the search is being done and a result is found it stores it as nzbname Mylar.log should show it

DGMayor commented 11 years ago

07-Jan-2013 18:10:46 - INFO :: CP Server Thread-6 : Marking Batman Beyond Unlimited issue: 11.00 as wanted... 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : mylar.newznab:True 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : initial newznab provider not enabled...checking for additional newznabs. 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : mylar.EXTRA_NEWZNABS:[] 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : there are : 2 search providers you have selected. 07-Jan-2013 18:10:46 - INFO :: CP Server Thread-6 : Shhh be very quiet...I'm looking for Batman Beyond Unlimited issue: 11.00(2013) using dognzb 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : IssueNumber: 11.00 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : ..before decimal: 11 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : ...after decimal: 00 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : let's search with this issue value: 11 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : int.issue :11000 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : int.issue_b4: 11 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : int.issue_dec: 0 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : comsearch: ['Batman%20Beyond%20Unlimited%20011%20'] 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : cmloopit: 2 07-Jan-2013 18:10:46 - DEBUG :: CP Server Thread-6 : done: False 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : checking search result: Batman.Beyond.Unlimited.011.(2013)(FB-DCP)(C2C) 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : Entry: Batman.Beyond.Unlimited.011.(2013)(FB-DCP)(C2C) 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : Cleantitle: batman beyond unlimited 011 (2013)(fb-dcp)(c2c) 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : 0. Bracket Word: batman beyond unlimited 011 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : Comic: batman beyond unlimited 011 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : 1. Bracket Word: 2013 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : year detected: 2013 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : 2013 - right years match baby! 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : 2. Bracket Word: fb-dcp 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : Scanner detected: fb-dcp 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : 3. Bracket Word: c2c 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : original nzb comic and issue: batman beyond unlimited 011 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : adjusted nzb comic and issue: batman beyond unlimited 011 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : adjusting from: batman beyond unlimited 011 to: 011 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : ['batman', 'beyond', 'unlimited', '011'] nzb series word count: 3 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : ['Batman', 'Beyond', 'Unlimited'] watchlist word count: 3 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : length match..proceeding 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : search-length: 3 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : Watchlist-length: 3 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : splitit: batman 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : 0 Comparing: Batman .to. batman 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : word matched on : batman 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : splitit: beyond 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : 1 Comparing: Beyond .to. beyond 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : word matched on : beyond 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : splitit: unlimited 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : 2 Comparing: Unlimited .to. unlimited 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : word matched on : unlimited 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : scount:3 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : splitit-len:3 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : we got 100.0 percent. 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : it's a go captain... - we matched 100.0%! 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : this should be a match! 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : issue we are looking for is : 11 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : integer value of issue we are looking for : 11000 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : issue we found for is : 011 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : integer value of issue we are found : 11000 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : issues match! 07-Jan-2013 18:10:48 - INFO :: CP Server Thread-6 : Found Batman Beyond Unlimited (2013) issue: 11 using dognzb 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : link given by: dognzb 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : link: https://dognzb.cr/fetch/2d3866a86e226f9aefa9172ab806f3ff/DOGAPI 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : linkforapi: https://dognzb.cr/fetch/2d3866a86e226f9aefa9172ab806f3ff/DOGAPI 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : cache directory successfully found at : C:\Mylar\cache/ 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : link to retrieve via api:https://dognzb.cr/fetch/2d3866a86e226f9aefa9172ab806f3ff/DOGAPI 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : nzbname used for post-processing:Batman_Beyond_Unlimited011(2013)(FB_DCP)(C2C) 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : send-to-SAB host string: http://172.16.61.75:8082 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : ...selecting API type: http://172.16.61.75:8082/api?mode=addurl&name= 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : ...attaching nzb provider link: http://172.16.61.75:8082/api?mode=addurl&name=https://dognzb.cr/fetch/2d3866a86e226f9aefa9172ab806f3ff/DOGAPI 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : ...attaching category: http://172.16.61.75:8082/api?mode=addurl&name=https://dognzb.cr/fetch/2d3866a86e226f9aefa9172ab806f3ff/DOGAPI&cat=Comics 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : ...attaching rename script: http://172.16.61.75:8082/api?mode=addurl&name=https://dognzb.cr/fetch/2d3866a86e226f9aefa9172ab806f3ff/DOGAPI&cat=Comics&script=ComicRN.py 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : Completed send-to-SAB link: http://172.16.61.75:8082/api?mode=addurl&name=https://dognzb.cr/fetch/2d3866a86e226f9aefa9172ab806f3ff/DOGAPI&cat=Comics&script=ComicRN.py&apikey=5ac180bc2ac11145c908a1c9bcde8e02 07-Jan-2013 18:10:48 - INFO :: CP Server Thread-6 : Successfully sent nzb file to SABnzbd 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : we should break out now - sucessful search previous 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : Found matching comic...preparing to send to Updater with IssueID: 376610 and nzbname: Batman_Beyond_Unlimited011(2013)(FB_DCP)(C2C) 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : findit = found! 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : updating status to snatched 07-Jan-2013 18:10:48 - DEBUG :: CP Server Thread-6 : updating snatched db. 07-Jan-2013 18:10:48 - INFO :: CP Server Thread-6 : Updating now complete for Batman Beyond Unlimited issue: 11.00 07-Jan-2013 18:11:01 - INFO :: CP Server Thread-3 : Starting postprocessing for : Batman.Beyond.Unlimited.011.(2013)(FB-DCP)(C2C) 07-Jan-2013 18:11:01 - INFO :: CP Server Thread-3 : SABnzbd setting: Replace Decimals is disabled. 07-Jan-2013 18:11:01 - INFO :: CP Server Thread-3 : SABnzbd setting: Replace spaces is disabled. 07-Jan-2013 18:11:01 - DEBUG :: CP Server Thread-3 : trying again with this nzbname: Batman.Beyond.Unlimited.011.(2013)(FB_DCP)(C2C) 07-Jan-2013 18:11:01 - ERROR :: CP Server Thread-3 : Unable to locate downloaded file to rename. PostProcessing aborted.

evilhero commented 11 years ago

Yeah that's dognzb alright replacing spaces with decimals. Easy enough to fix just need sit down to do it. Expect the fix in the next hr or so while I have the time :)

DGMayor commented 11 years ago

Well right on :+1:

bebetech commented 11 years ago

Is there a way to manually run this for those issues that have already been downloaded and left orphaned in the SAB download folder?

DGMayor commented 11 years ago

Alright - so I retested Earth 2 issue 0 and it downloaded and post-processed fine, so I would say this issue it technically fixed, however it is still showing snatched in Mylar and it also led to

https://github.com/evilhero/mylar/issues/139

evilhero commented 11 years ago

bebetech: No not as of yet - I need to rework the logic and calls to be able to do that since it has to scan a folder and then import it it (which hasn't been built yet...I'm slow)