Closed rupaschomaker closed 3 years ago
evilhero
commented
9 years ago I don't use nzbid, is it possible that they're using a non-newznab service or they modified the get parameter within their api structure?
The last error is in relation to your cache directory -it looks like mylar can't write the nzb to it. Whether it's permissions or something similar, it's erroring out due to the inability to write (thus the file doesn't exist error)
rupaschomaker
commented
9 years ago Looked closer.
The cache directory looks sane to me:
Storage> pwd
/usr/local/mylar/share/mylar/cache
Storage> ls -ld .
drwxr-xr-x 2 mylar root 32768 2015-09-02 17:45 .Interesting that there is actually a copy of the alternate NZB name:
Storage> ls -l Americatown* -rw-rw---- 1 mylar users 21396 2015-09-02 23:37 Americatown.001.2015.digital.dargh-Empire.nzb
The log talks about how the rss feed has a different filename and storing that in extra value, but then it looks like everything after is not looking at the alternate name?
evilhero
commented
9 years ago Ugh yeah that's because it's coming from the raw indexer. It has that [1/9] crap at the end at it looks like it's throwing in a blank space incorrectly so it's not matching up when it comes time to check the nzb file it downloaded for validity (sometimes the filenames of the nzbs on indexes don't match up exactly to the cbr inside of the downloaded archive - in this case, from the experimental search).
I'll have to look into this more as it's going to require abit of testing to get it right.
evilhero
commented
9 years ago Meh - ok, it's due to the fact that the nzbname has a '/' which it's interpreting as a path since it's trying to write that filename as it is.
Still working on it, but just an update ;)
EDIT.
03-Sep-2015 15:06:58 - DEBUG :: Thread-13 : [SEARCHER] entry[title]: Americatown 001 (2015) (digital) (d'argh-Empire) [1/9] -
03-Sep-2015 15:06:58 - DEBUG :: Thread-13 : [SEARCHER] nzbname (remove chars): Americatown 001 2015 digital dargh-Empire [1/9] -
03-Sep-2015 15:06:58 - DEBUG :: Thread-13 : [SEARCHER] nzbname (\s): Americatown 001 2015 digital dargh-Empire [1/9] -
03-Sep-2015 15:06:58 - DEBUG :: Thread-13 : [SEARCHER] end nzbname: Americatown.00.205.digital.dargh-Empire.[].-
03-Sep-2015 15:06:58 - DEBUG :: Thread-13 : nzbname used for post-processing:Americatown.00.205.digital.dargh-Empire.[].-
03-Sep-2015 15:06:58 - DEBUG :: Thread-13 : [experimental] link: http://nzbindex.nl/download/124199712/Americatown-001-2015-digital-dargh-Empire-19-Americatown-001-2015-digital....
03-Sep-2015 15:06:58 - INFO :: Thread-13 : Download URL: http://nzbindex.nl/download/124199712/Americatown-001-2015-digital-dargh-Empire-19-Americatown-001-2015-digital-dargh-...
03-Sep-2015 15:06:59 - DEBUG :: Thread-13 : [FILENAME] filename (remove chars): Americatown 001 2015 digital dargh-Empire .cbr.nzb
03-Sep-2015 15:06:59 - DEBUG :: Thread-13 : [FILENAME] nzbname (\s): Americatown 001 2015 digital dargh-Empire .nzb
03-Sep-2015 15:06:59 - DEBUG :: Thread-13 : [FILENAME] end nzbname: Americatown.001.2015.digital.dargh-Empire..nzb
03-Sep-2015 15:06:59 - INFO :: Thread-13 : filen: Americatown.001.2015.digital.dargh-Empire. -- nzbname: Americatown.00.205.digital.dargh-Empire.[].- are not identical. Storing extra value as : Americatown.001.2015.digital.dargh-Empire.
03-Sep-2015 15:06:59 - DEBUG :: Thread-13 : Cache Directory successfully found at : /home/hero/mylar/cache/. Ensuring proper permissions.
03-Sep-2015 15:06:59 - DEBUG :: Thread-13 : Successfully changed ownership and permissions [zipper:ninjas] / [0777 / 0777]
03-Sep-2015 15:06:59 - INFO :: Thread-13 : prov : experimental[124199712]Working now, just want to clean up the nzbname abit more so it won't have any problems during post-processing (it worked during post-processsing, it's just ugly to have '[].-' lol )
rupaschomaker
commented
9 years ago Thanks. Figured it was a bit out of my comfort level...
On Thu, Sep 3, 2015, 1:32 PM evilhero notifications@github.com wrote:
Meh - ok, it's due to the fact that the nzbname has a '/' which it's interpreting as a path since it's trying to write that filename as it is.
Still working on it, but just an update ;)
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1124#issuecomment-137536388.
rupaschomaker
commented
9 years ago Another example, this time with the experimental index. Looks like no trailing / on it though:
04-Sep-2015 08:16:01 - INFO :: RSSCHECK : Shhh be very quiet...I'm looking for The Beauty issue: 1 (2015) using experimental [RSS]
04-Sep-2015 08:16:01 - DEBUG :: RSSCHECK : calpha/cnumber: None / None
04-Sep-2015 08:16:01 - DEBUG :: RSSCHECK : RSS Check: yes
04-Sep-2015 08:16:01 - DEBUG :: RSSCHECK : nzbprov: experimental
04-Sep-2015 08:16:01 - DEBUG :: RSSCHECK : comicid: 83799
04-Sep-2015 08:16:01 - DEBUG :: RSSCHECK : Sending request to RSS for The Beauty : 001 (2015)
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : checking search result: The Beauty 001 (2015) (Digital) (DR & Quinch-Empire) [1/10] -
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : size given as: 293.5 MB
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : comparing Min threshold 5242880 .. to .. nzb 307728367
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : Thu, 13 Aug 2015 23:13:12 +0200 is after store date of 2015-08-12
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : Entry: The Beauty 001 (2015) (Digital) (DR & Quinch-Empire) [1/10] -
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : Cleantitle: the beauty 001 (2015) (digital) (dr and quinch-empire) 110 -
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : Cleantitle: the beauty 001 (2015) (digital) (dr and quinch-empire) 110 -
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : 0. Bracket Word: the beauty 001
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : Comic: the beauty 001
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : UseFuzzy is : None
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : ComVersChk : 0
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : Series version detected as V1 (only series in existance with that title). Bypassing Year/Volume check
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : 1. Bracket Word: 2015
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : year detected: 2015
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : year looking for: 2015
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : 2015 - right years match baby!
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : 3. Bracket Word: digital
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : digital edition detected
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : 5. Bracket Word: dr and quinch-empire
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : Scanner detected: dr and quinch-empire
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : 6. Bracket Word: 110 -
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : original nzb comic and issue: the beauty 001
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : adjusted nzb comic and issue: the beauty 001
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : adjusting from: the beauty 001 to: 001
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : ['the', 'beauty', '001'] nzb series word count: 2
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : ['the', 'beauty'] watchlist word count: 2
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : splitst : 2
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : len-watchcomic : 2
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : length match..proceeding
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : search-length: 2
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : Watchlist-length: 2
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : splitit: the
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : scount : 0
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : 0 Comparing: the .to. the
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : word matched on : the
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : splitit: beauty
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : scount : 1
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : 1 Comparing: beauty .to. beauty
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : word matched on : beauty
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : scount:2
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : splitit-len:2
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : Match to series : 100.0 %.
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : it's a go captain... - we matched 100.0%!
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : this should be a match!
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : issue we are looking for is : 1
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : integer value of issue we are looking for : 1000
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : issue we found for is : 001
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : integer value of issue we have found : 1000
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : [SEARCHER] entry[title]: The Beauty 001 (2015) (Digital) (DR & Quinch-Empire) [1/10] -
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : [SEARCHER] nzbname (remove chars): The Beauty 001 2015 Digital DR and Quinch-Empire [1/10] -
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : [SEARCHER] nzbname (\s): The Beauty 001 2015 Digital DR and Quinch-Empire [1/10] -
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : [SEARCHER] end nzbname: The.Beauty.001.2015.Digital.DR.and.Quinch-Empire.[1/10].-
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : nzbname used for post-processing:The.Beauty.001.2015.Digital.DR.and.Quinch-Empire.[1/10].-
04-Sep-2015 08:16:02 - DEBUG :: RSSCHECK : [experimental] link: http://nzbindex.nl/download/124165044/The-Beauty-001-2015-Digital-DR-Quinch-Empire-110-The-Beauty-001-2015-Digital-DR-Quinch-Empire.cbr.nzb
04-Sep-2015 08:16:02 - INFO :: RSSCHECK : Download URL: http://nzbindex.nl/download/124165044/The-Beauty-001-2015-Digital-DR-Quinch-Empire-110-The-Beauty-001-2015-Digital-DR-Quinch-Empire.cbr.nzb [VerifySSL:False]
04-Sep-2015 08:16:07 - DEBUG :: RSSCHECK : [FILENAME] filename (remove chars): The Beauty 001 2015 Digital DR and Quinch-Empire .cbr.nzb
04-Sep-2015 08:16:07 - DEBUG :: RSSCHECK : [FILENAME] nzbname (\s): The Beauty 001 2015 Digital DR and Quinch-Empire .nzb
04-Sep-2015 08:16:07 - DEBUG :: RSSCHECK : [FILENAME] end nzbname: The.Beauty.001.2015.Digital.DR.and.Quinch-Empire..nzb
04-Sep-2015 08:16:07 - INFO :: RSSCHECK : filen: The.Beauty.001.2015.Digital.DR.and.Quinch-Empire. -- nzbname: The.Beauty.001.2015.Digital.DR.and.Quinch-Empire.[1/10].- are not identical. Storing extra value as : The.Beauty.001.2015.Digital.DR.and.Quinch-Empire.
04-Sep-2015 08:16:07 - DEBUG :: RSSCHECK : Cache Directory successfully found at : /usr/local/mylar/share/mylar/cache/. Ensuring proper permissions.
04-Sep-2015 08:16:07 - DEBUG :: RSSCHECK : Successfully changed permissions [0777 / 0660]
04-Sep-2015 08:16:07 - DEBUG :: RSSCHECK : Exception generated in thread RSSCHECK: [Errno 2] No such file or directory: u'/usr/local/mylar/share/mylar/cache/The.Beauty.001.2015.Digital.DR.and.Quinch-Empire.[1/10].-.nzb'
04-Sep-2015 08:16:07 - DEBUG :: RSSCHECK : 'Traceback (most recent call last):\n File "/volume1/@appstore/mylar/share/mylar/mylar/scheduler.py", line 78, in runAction\n self.action.run()\n File "/volume1/@appstore/mylar/share/mylar/mylar/rsscheckit.py", line 97, in run\n mylar.search.searchforissue(rsscheck=\'yes\')\n File "/volume1/@appstore/mylar/share/mylar/mylar/search.py", line 1490, in searchforissue\n foundNZB, prov = search_init(comic[\'ComicName\'], result[\'Issue_Number\'], str(ComicYear), comic[\'ComicYear\'], Publisher, IssueDate, StoreDate, result[\'IssueID\'], AlternateSearch, UseFuzzy, ComicVersion, SARC=None, IssueArcID=None, mode=mode, rsscheck=rsscheck, ComicID=result[\'ComicID\'], filesafe=comic[\'ComicName_Filesafe\'])\n File "/volume1/@appstore/mylar/share/mylar/mylar/search.py", line 220, in search_init\n findit = NZB_SEARCH(ComicName, IssueNumber, ComicYear, SeriesYear, Publisher, IssueDate, StoreDate, searchprov, prov_count, IssDateFix, IssueID, UseFuzzy, newznab_host, ComicVersion=ComicVersion, SARC=SARC, IssueArcID=IssueArcID, RSS="yes", ComicID=ComicID, issuetitle=issuetitle, unaltered_ComicName=unaltered_ComicName)\n File "/volume1/@appstore/mylar/share/mylar/mylar/search.py", line 1367, in NZB_SEARCH\n searchresult = searcher(nzbprov, nzbname, comicinfo, entry[\'link\'], IssueID, ComicID, tmpprov, newznab=newznab_host)\n File "/volume1/@appstore/mylar/share/mylar/mylar/search.py", line 1857, in searcher\n with open(nzbpath, \'wb\') as f:\nIOError: [Errno 2] No such file or directory: u\'/usr/local/mylar/share/mylar/cache/The.Beauty.001.2015.Digital.DR.and.Quinch-Empire.[1/10].-.nzb\'\n'It's actually the '[1/10]' portion that's causing the problem, same as the other. I'll test the fix against this one too just to be sure (never hurts), and will roll it out later today for you to run through its paces. ;)
The alternate nzb name has no bearing on anything other than post-processing, but in these cases it just can't write the nzb name itself to the cache directory because of the #of parts posting included in the header.
Anyone else seeing this? If I click the download link, my browser downloads the nzb just fine.