search

evilhero / mylar

An automated Comic Book downloader (cbr/cbz) for use with SABnzbd, NZBGet and torrents
GNU General Public License v3.0
977 stars 173 forks source link

New Errors #750

Closed AtariBaby closed 9 years ago

AtariBaby commented 10 years ago 
15-Jun-2014 19:38:43 - DEBUG   :: MAIN : calpha/cnumber: None / None
15-Jun-2014 19:38:43 - DEBUG   :: MAIN : RSS Check: yes
15-Jun-2014 19:38:43 - DEBUG   :: MAIN : nzbprov: dognzb
15-Jun-2014 19:38:43 - DEBUG   :: MAIN : comicid: 5922
15-Jun-2014 19:38:43 - DEBUG   :: MAIN : Sending request to RSS for Finder : 035 (0000)
15-Jun-2014 19:38:43 - DEBUG   :: MAIN : bb results: {'entries': [{'length': u'0', 'link': u'https://dognzb.cr/fetch/d2c241d88c61bacd17827176a17668f9/664fb44f3b9c779146dcf2c91f17faf7', 'site': u'dognzb', 'pubdate': u'Wed, 11 Jun 2014 16:49:33 -0600', 'title': u'Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE'}]}
15-Jun-2014 19:38:43 - DEBUG   :: MAIN : checking search result: Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE
15-Jun-2014 19:38:43 - ERROR   :: MAIN : Uncaught exception: Traceback (most recent call last):
  File "Mylar.py", line 197, in <module>
    main()
  File "Mylar.py", line 175, in main
    mylar.start()
  File "/home/misterfantastic/.mylar/mylar/__init__.py", line 1246, in start
    rsscheck.tehMain()
  File "/home/misterfantastic/.mylar/mylar/rsscheck.py", line 52, in tehMain
    mylar.search.searchforissue(rsscheck='yes')
  File "/home/misterfantastic/.mylar/mylar/search.py", line 1400, in searchforissue
    foundNZB, prov = search_init(comic['ComicName'], result['Issue_Number'], str(ComicYear), comic['ComicYear'], Publisher, IssueDate, StoreDate, result['IssueID'], AlternateSearch, UseFuzzy, ComicVersion, SARC=None, IssueArcID=None, mode=mode, rsscheck=rsscheck, ComicID=result['ComicID'])
  File "/home/misterfantastic/.mylar/mylar/search.py", line 191, in search_init
    findit = NZB_SEARCH(ComicName, IssueNumber, ComicYear, SeriesYear, Publisher, IssueDate, StoreDate, searchprov, prov_count, IssDateFix, IssueID, UseFuzzy, newznab_host, ComicVersion=ComicVersion, SARC=SARC, IssueArcID=IssueArcID, RSS="yes", ComicID=ComicID)
  File "/home/misterfantastic/.mylar/mylar/search.py", line 617, in NZB_SEARCH
    issue_convert = datetime.datetime.strptime(stdate.rstrip(), '%Y-%m-%d')
  File "/usr/lib/python2.7/_strptime.py", line 325, in _strptime
    (data_string, format))
ValueError: time data '0000-00-00' does not match format '%Y-%m-%d'

15-Jun-2014 19:56:08 - INFO    :: Thread-13 : Updating complete for: Ms. Marvel
15-Jun-2014 19:56:08 - INFO    :: Thread-13 : returning to dbupdate module
15-Jun-2014 19:56:08 - DEBUG   :: Thread-13 : Attempting to put the Status' back how they were.
15-Jun-2014 19:56:08 - INFO    :: Thread-13 : In the process of converting the data to CV, I changed the status of 0 issues.
15-Jun-2014 19:56:08 - INFO    :: Thread-12 : I have added 0 new issues for this series that were not present before.
15-Jun-2014 19:56:08 - INFO    :: Thread-13 : I have added 0 new issues for this series that were not present before.
15-Jun-2014 19:56:13 - DEBUG   :: Thread-12 : Refreshing comicid: 66049
15-Jun-2014 19:56:13 - DEBUG   :: Thread-12 : CV_OneTimer option enabled...
15-Jun-2014 19:56:13 - DEBUG   :: Thread-12 : Gathering the status of all issues for the series.
15-Jun-2014 19:56:13 - DEBUG   :: Thread-12 : Deleting all issue data.
15-Jun-2014 19:56:13 - DEBUG   :: Thread-13 : Refreshing comicid: 66049
15-Jun-2014 19:56:13 - DEBUG   :: Thread-13 : CV_OneTimer option enabled...
15-Jun-2014 19:56:13 - DEBUG   :: Thread-13 : Gathering the status of all issues for the series.
15-Jun-2014 19:56:13 - DEBUG   :: Thread-12 : Refreshing the series and pulling in new data using only CV.
15-Jun-2014 19:56:13 - DEBUG   :: Thread-13 : Deleting all issue data.
15-Jun-2014 19:56:13 - DEBUG   :: Thread-13 : Refreshing the series and pulling in new data using only CV.
15-Jun-2014 19:56:13 - INFO    :: Thread-12 : Found comic directory: /media/storage/Dropbox/Comics/The Bunker (2013)
15-Jun-2014 19:56:13 - INFO    :: Thread-13 : Found comic directory: /media/storage/Dropbox/Comics/The Bunker (2013)
15-Jun-2014 19:56:14 - DEBUG   :: Thread-13 : number of issues I counted: 0
15-Jun-2014 19:56:14 - DEBUG   :: Thread-13 : number of issues CV says it has: 0
15-Jun-2014 19:56:14 - DEBUG   :: Thread-13 : vari is set to: no
15-Jun-2014 19:56:14 - ERROR   :: Thread-13 : Uncaught exception: Traceback (most recent call last):
  File "/home/misterfantastic/.mylar/mylar/logger.py", line 141, in new_run
    old_run(*args, **kwargs)
  File "/usr/lib/python2.7/threading.py", line 763, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/home/misterfantastic/.mylar/mylar/updater.py", line 85, in dbUpdate
    mylar.importer.addComictoDB(ComicID,mismatch,calledfrom='dbupdate',annload=annload)
  File "/home/misterfantastic/.mylar/mylar/importer.py", line 78, in addComictoDB
    comic = cv.getComic(comicid,'comic')
  File "/home/misterfantastic/.mylar/mylar/cv.py", line 104, in getComic
    return GetComicInfo(comicid,dom)
  File "/home/misterfantastic/.mylar/mylar/cv.py", line 164, in GetComicInfo
    comic['ComicURL'] = dom.getElementsByTagName('site_detail_url')[trackcnt].firstChild.wholeText
IndexError: list index out of range

15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : number of issues I counted: 5
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : number of issues CV says it has: 5
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : vari is set to: no
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : comic[ComicVersion]:noversion
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : comic[ComicVersion]:noversion
15-Jun-2014 19:56:14 - INFO    :: Thread-12 : Now adding/updating: The Bunker
15-Jun-2014 19:56:14 - INFO    :: Thread-12 : Sucessfully retrieved details for The Bunker
15-Jun-2014 19:56:14 - INFO    :: Thread-12 : Directory (/media/storage/Dropbox/Comics/The Bunker (2013)) already exists! Continuing...
15-Jun-2014 19:56:14 - INFO    :: Thread-12 : Successfully retrieved cover for The Bunker
15-Jun-2014 19:56:14 - INFO    :: Thread-12 : previous version detected as None - seeing if update required
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : there are 0 search results...
15-Jun-2014 19:56:14 - INFO    :: Thread-12 : Sucessfully retrieved issue details for The Bunker
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : issuedata call references...
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : comicid:66049
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : comicname:The Bunker
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : comicissues:5
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : calledfrom: dbupdate
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : issuechk: None
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : issuetype: None
15-Jun-2014 19:56:14 - INFO    :: Thread-12 : Now adding/updating issues for The Bunker
15-Jun-2014 19:56:14 - DEBUG   :: Thread-12 : initiating issue updating - just the info
15-Jun-2014 19:56:14 - ERROR   :: Thread-12 : Uncaught exception: Traceback (most recent call last):
  File "/home/misterfantastic/.mylar/mylar/logger.py", line 141, in new_run
    old_run(*args, **kwargs)
  File "/usr/lib/python2.7/threading.py", line 763, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/home/misterfantastic/.mylar/mylar/updater.py", line 85, in dbUpdate
    mylar.importer.addComictoDB(ComicID,mismatch,calledfrom='dbupdate',annload=annload)
  File "/home/misterfantastic/.mylar/mylar/importer.py", line 492, in addComictoDB
    issuedata = updateissuedata(comicid, comic['ComicName'], issued, comicIssues, calledfrom, SeriesYear=SeriesYear)
  File "/home/misterfantastic/.mylar/mylar/importer.py", line 1242, in updateissuedata
    c_date = datetime.date(int(latestdate[:4]),int(latestdate[5:7]),1)
ValueError: year is out of range

15-Jun-2014 19:56:37 - INFO    :: CP Server Thread-10 : Starting postprocessing for : Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : nzb name: Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : nzb folder: /media/storage/Downloads/complete/comics/Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : After conversions, nzbname is : Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : issueid:456038
15-Jun-2014 19:56:37 - INFO    :: Thread-16 : issuenzb found.
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : issueid: 456038
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : issuenumOG: 2
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Zero Suppression set to : none
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Pretty Comic Issue is : 2
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Issue Year : 2014
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Publisher: Dynamite Entertainment
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Series: Pathfinder: City of Secrets
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Year: 2014
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Comic Location: /media/storage/Dropbox/Comics/Pathfinder City of Secrets (2014)
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Comic Version: None
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : No version # found for series, removing from filename
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : new format is now: $Series $Issue ($Year)
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : not an annual - removing from filename paramaters
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : new format: $Series $Issue ($Year)
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : odir: /media/storage/Downloads/complete/comics/Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : ofilename: Pathfinder- City of Secrets 002 (2014) (Digital) (K6-Empire).cbr
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Original Filname: Pathfinder- City of Secrets 002 (2014) (Digital) (K6-Empire).cbr
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Original Extension: .cbr
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Rename Files isn't enabled - keeping original filename.
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : New Filename: Pathfinder- City of Secrets 002 (2014) (Digital) (K6-Empire)
15-Jun-2014 19:56:37 - INFO    :: Thread-16 : Found comic directory: /media/storage/Dropbox/Comics/Pathfinder City of Secrets (2014)
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Source: /media/storage/Downloads/complete/comics/Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE/Pathfinder- City of Secrets 002 (2014) (Digital) (K6-Empire).cbr
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : Destination: /media/storage/Dropbox/Comics/Pathfinder City of Secrets (2014)/Pathfinder- City of Secrets 002 (2014) (Digital) (K6-Empire).cbr
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : self.nzb_folder: /media/storage/Downloads/complete/comics/Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : odir: /media/storage/Downloads/complete/comics/Pathfinder-.City.Of.Secrets.002.2014.Digital.K6-EMPIRE
15-Jun-2014 19:56:37 - DEBUG   :: Thread-16 : ofilename:Pathfinder- City of Secrets 002 (2014) (Digital) (K6-Empire).cbr
evilhero commented 10 years ago

Are you using your own comicvine api key? Most of those errors seem all related to having stale issuedata, either because cv has it listed incorrectly, or the api limit has been reached on the generic api and it can't pull down new data (or if you have your own, you may have reached the 200 hits / 15 minutes).

AtariBaby commented 10 years ago

Yeah, I got my own api...

On 6/15/14, 8:38 PM, evilhero wrote:

Are you using your own comicvine api key? Most of those errors seem all related to having stale issuedata, either because cv has it listed incorrectly, or the api limit has been reached on the generic api and it can't pull down new data (or if you have your own, you may have reached the 200 hits / 15 minutes).

— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/750#issuecomment-46138729.

evilhero commented 10 years ago

Are the issue dates for each of those series listed as 0000-00-00 in the comic details screen ? I tried both and was able to add both without any errors (and no issue dates were listed as 0000-00-00, so it's not the series' themselves that have inconsistent data) and the searching worked fine as well. If you have 0000-00-00 in your dates for those series, then you've hit your 200/15 limit, and need to wait the 15 minutes before retrying again.

rupaschomaker commented 10 years ago

I sent a pull request to skip over searches with a pub date of 0000-00-00. On Jun 15, 2014 10:55 PM, "evilhero" notifications@github.com wrote:

Are the issue dates for each of those series listed as 0000-00-00 in the comic details screen ? I tried both and was able to add both without any errors and the searching worked fine as well. If you have 0000-00-00 in your dates for those series, then you've hit your 200/15 limit, and need to wait the 15 minutes before retrying again.

— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/750#issuecomment-46139252.

evilhero commented 10 years ago

Yep, I just commented on that (sorry, got lost in all of the shuffle). The pull request (or even the modifed lines I suggested), would only address the first one of the errors listed here. The other ones, while all date related, are from the importer module (which is used for refreshing series), and is related to the stale issuedata which should be handled in a more graceful manner when it encounters 0000-00-00 issue dates.

rupaschomaker commented 10 years ago

conversation continued on the issue...

On Sun, Jun 15, 2014 at 11:41 PM, evilhero notifications@github.com wrote:

Yep, I just commented on that (sorry, got lost in all of the shuffle). The pull request (or even the modifed lines I suggested), would only address the first one of the errors listed here. The other ones, while all date related, are from the importer module (which is used for refreshing series), and is related to the stale issuedata which should be handled in a more graceful manner when it encounters 0000-00-00 issue dates.

— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/750#issuecomment-46140633.

-Rupa