Closed cetheridge30 closed 8 years ago
Which branch of mylar are you running?
Also, are you running a version of python > 2.7.7?
Do you have an entry in the config.ini for the kat_proxy value?
KAT works fine for me, so it's quite possibly some other issue / configuration problem that's occuring for you.
I am running python 2.7.9 and have the development branch. I have double checked all of my settings and I have not found anything that has changed from when it was working.
On Tue, Dec 1, 2015 at 6:00 PM, evilhero notifications@github.com wrote:
Which branch of mylar are you running?
Also, are you running a version of python > 2.7.7?
KAT works fine for me, so it's quite possibly some other issue / configuration problem that's occuring for you.
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161124392.
-Chris Etheridge
It might be the commit you're running as it might not be up to date. What commit are you currently running? (It's listed on the bottom of every page as well as on the 1st tab in the configuration).
There were some KAT issues about a month ago where it wasn't able to find anything let alone grab the torrents...but it was fixed.
efe447f5170dfcea873b5da735c2fd66d2fe9936 (development)
On Tue, Dec 1, 2015 at 9:42 PM, evilhero notifications@github.com wrote:
It might be the commit you're running as it might not be up to date. What commit are you currently running? (It's listed on the bottom of every page as well as on the 1st tab in the configuration).
There were some KAT issues about a month ago where it wasn't able to find anything let alone grab the torrents...but it was fixed.
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161161334.
-Chris Etheridge
What do you have your minimum # of seeders set to within mylar?
Also check you config.ini and verify you don't have kat_proxy in use, and/or that you can hit https://kat.cr from a browser that mylar is running on.
I set the minimum seeders to 1. I figured that it made sense to find a torrent that someone was seeding. No proxy, and I can successfully get to https://kat.cr. That is normally the address I use for KAT when downloading manually.
On Wed, Dec 2, 2015 at 8:22 AM, evilhero notifications@github.com wrote:
What do you have your minimum # of seeders set to within mylar?
Also check you config.ini and verify you don't have kat_proxy in use, and/or that you can hit https://kat.cr from a browser that mylar is running on.
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161288114.
-Chris Etheridge
With KAT the number of seeders sometimes doesn't update properly on the feeds - try setting the seeders to 0, saving the configuration and restarting mylar for the changes to take effect.
If it works with the above change, then I'll need to rejig the logistics for the kat seeders as it's not polling them properly.
I changed it to 0 and restarted. Still no change. Just getting a bunch of 0 results.
On Wed, Dec 2, 2015 at 3:09 PM, evilhero notifications@github.com wrote:
With KAT the number of seeders sometimes doesn't update properly on the feeds - try setting the seeders to 0, saving the configuration and restarting mylar for the changes to take effect.
If it works with the above change, then I'll need to rejig the logistics for the kat seeders as it's not polling them properly.
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161418408.
-Chris Etheridge
There's something happening on your end somewhere - I was able to download both issues you posted in your log from KAT with no issues.
The only thing I can think of is a configuration problem of some kind if you've already tested connectivity being ok.
Can you paste in your config.ini? ( just remove the api keys prior )
api keys removed:
[General] config_version = 5 dbchoice = sqlite3 dbuser = "" dbpass = "" dbname = "" comicvine_api = cvapi_rate = 2 http_port = 8090 http_host = 0.0.0.0 http_username = "" http_password = "" http_root = / enable_https = 0 https_cert = "" https_key = "" https_force_on = 0 host_return = "" api_enabled = 0 api_key = "" launch_browser = 1 auto_update = 0 log_dir = /share/CACHEDEV1_DATA/.qpkg/Mylar/config/logs max_logsize = 1000000 logverbose = 0 git_path = "" cache_dir = /share/CACHEDEV1_DATA/.qpkg/Mylar/config/cache annuals_on = 0 cv_only = 1 cv_onetimer = 1 check_github = 1 check_github_on_startup = 1 check_github_interval = 360 git_user = evilhero git_branch = development destination_dir = /share/CACHEDEV1_DATA/Comics multiple_dest_dirs = "" create_folders = 1 delete_remove_dir = 0 chmod_dir = 0777 chmod_file = 0660 chowner = "" chgroup = "" usenet_retention = 1500 alt_pull = 0 search_interval = 360 nzb_startup_search = 0 libraryscan = 1 libraryscan_interval = 300 add_comics = 0 comic_dir = "" imp_move = 0 imp_rename = 0 imp_metadata = 0 enable_check_folder = 0 download_scan_interval = 5 check_folder = "" interface = default dupeconstraint = filesize autowant_all = 0 autowant_upcoming = 1 preferred_quality = 0 comic_cover_local = 0 correct_metadata = 0 move_files = 0 rename_files = 0 folder_format = $Series ($Year) file_format = $Series $Issue ($Year) blackhole_dir = /share/CACHEDEV1_DATA/Download/transmission/watch replace_spaces = 0 replace_char = . zero_level = 0 zero_level_n = none lowercase_filenames = 0 ignore_havetotal = 0 snatched_havetotal = 0 syno_fix = 0 search_delay = 1 grabbag_dir = /share/CACHEDEV1_DATA/Comics highcount = 0 read2filename = 0 send2read = 0 tab_enable = 0 tab_host = "" tab_user = "" tab_pass = "" tab_directory = "" storyarcdir = 0 copy2arcdir = 0 use_minsize = 0 minsize = "" use_maxsize = 0 maxsize = "" add_to_csv = 1 cvinfo = 0 log_level = 0 enable_extra_scripts = 0 extra_scripts = "" enable_pre_scripts = 0 pre_scripts = "" post_processing = 0 post_processing_script = "" weekfolder = 0 locmove = 0 newcom_dir = "" fftonewcom_dir = 0 enable_meta = 0 cmtagger_path = None ct_tag_cr = 1 ct_tag_cbl = 1 ct_cbz_overwrite = 0 unrar_cmd = None update_ended = 0 indie_pub = 75 biggie_pub = 55 upcoming_snatched = 1 enable_rss = 1 rss_checkinterval = 20 rss_lastrun = 2015-12-02 20:09:24 failed_download_handling = 0 failed_auto = 0 provider_order = 0, kat, 1, Experimental nzb_downloader = 2 [Torrents] enable_torrents = 1 minseeds = 0 torrent_local = 1 local_watchdir = /share/CACHEDEV1_DATA/Download/transmission/watch torrent_seedbox = 0 seedbox_host = "" seedbox_port = "" seedbox_user = "" seedbox_pass = "" seedbox_watchdir = "" enable_torrent_search = 1 enable_kat = 1 kat_proxy = "" enable_32p = 0 mode_32p = 0 passkey_32p = "" rssfeed_32p = "" username_32p = "" password_32p = "" verify_32p = 1 snatchedtorrent_notify = 0 [SABnzbd] sab_host = http://http: sab_username = "" sab_password = "" sab_apikey = "" sab_category = "" sab_priority = Default sab_to_mylar = 0 sab_directory = "" [NZBGet] nzbget_host = "" nzbget_port = "" nzbget_username = "" nzbget_password = "" nzbget_category = "" nzbget_priority = Default nzbget_directory = "" [NZBsu] nzbsu = 0 nzbsu_uid = "" nzbsu_apikey = "" [DOGnzb] dognzb = 0 dognzb_apikey = "" [OMGWTFNZBS] omgwtfnzbs = 0 omgwtfnzbs_username = "" omgwtfnzbs_apikey = "" [Experimental] experimental = 0 altexperimental = 1 [Torznab] enable_torznab = 0 torznab_name = "" torznab_host = "" torznab_apikey = "" torznab_category = "" [Newznab] newznab = 0 extra_newznabs = , [Prowl] prowl_enabled = 0 prowl_keys = "" prowl_onsnatch = 0 prowl_priority = 0 [NMA] nma_enabled = 0 nma_apikey = "" nma_priority = 0 nma_onsnatch = 0 [PUSHOVER] pushover_enabled = 0 pushover_apikey = "" pushover_userkey = "" pushover_priority = 0 pushover_onsnatch = 0 [BOXCAR] boxcar_enabled = 0 boxcar_onsnatch = 0 boxcar_token = "" [PUSHBULLET] pushbullet_enabled = 0 pushbullet_apikey = "" pushbullet_deviceid = None pushbullet_onsnatch = 0
On Wed, Dec 2, 2015 at 5:51 PM, evilhero notifications@github.com wrote:
There's something happening on your end somewhere - I was able to download both issues you posted in your log from KAT with no issues.
The only thing I can think of is a configuration problem of some kind if you've already tested connectivity being ok.
Can you paste in your config.ini? ( just remove the api keys prior )
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161459146.
-Chris Etheridge
When you do a Force RSS check from the Search Providers tab in thr configuration, do the logs indicate that it's able to retrieve the feeds properly from KAT ?
The '0 results' is normal for searches as it goes through all iterations of numeric issue (ie. For issue 1, it would search 001, 01,and 1). The fact that that's all it says would mean that it's unable to parse the returned xml properly or there s no xml that was returned.
Sorry for all the questions, I'm abit stumped atm as to why it's not working on your end.
Looks like it successfully completed a forced check. Here is the log:
03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : Checking for torrent enabled. 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : nzbprovider(s): [] 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : there are : 1 torrent providers you have selected. 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : there are : 0 nzb providers you have selected. 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : Usenet Retention : 1500 days 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : found provider in existing enabled providers. 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : checking against torrent provider: kat 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : torrent provider found: kat 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : provider order sequence is now to start with kat at spot #0 03-Dec-2015 07:32:19 - INFO :: Thread-12 : search provider order is ['kat'] 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : Initiating Search via : rss 03-Dec-2015 07:32:19 - INFO :: Thread-12 : Shhh be very quiet...I'm looking for Action Comics issue: 47 (2016) using KAT [RSS] 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : calpha/cnumber: None / None 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : RSS Check: yes 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : nzbprov: KAT 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : comicid: 42563 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : Sending request to [KAT] RSS for Action Comics : 047 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : ComicID: 42563 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : tsearch : action%comics% 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : seriesname_alt:None 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : RSS Check: yes 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : nzbprov: KAT 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : comicid: 42563 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : Sending request to [KAT] RSS for Action Comics : 47 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : ComicID: 42563 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : tsearch : action%comics% 03-Dec-2015 07:32:19 - DEBUG :: Thread-12 : seriesname_alt:None 03-Dec-2015 07:32:19 - INFO :: Thread-12 : Could not find Issue 47 of Action Comics(2011) using KAT [rss] 03-Dec-2015 07:32:19 - INFO :: Thread-12 : Finished searching via :rss. Issue not found - status kept as Wanted. 03-Dec-2015 07:32:19 - INFO :: Thread-12 : Completed RSS Search scan 03-Dec-2015 07:32:19 - INFO :: Thread-12 : [RSS] Watchlist Check complete. 03-Dec-2015 07:32:19 - INFO :: Thread-12 : [RSS] Successfully ran a forced RSS Check.
On Wed, Dec 2, 2015 at 9:55 PM, evilhero notifications@github.com wrote:
When you do a Force RSS check from the Search Providers tab in thr configuration, do the logs indicate that it's able to retrieve the feeds properly from KAT ?
The '0 results' is normal for searches as it goes through all iterations of numeric issue (ie. For issue 1, it would search 001, 01,and 1). The fact that that's all it says would mean that it's unable to parse the returned xml properly or there s no xml that was returned.
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161500953.
-Chris Etheridge
That's not the actual portion of the check I was thinking of - it's at the very start of the rss check and starts with '[RSS] Initiating Forced RSS Check.' and then lists the number of items in each feed and if it updated the table correctly.
Keep in mind that it might cycle through the logs before you can see it, but you should still be able to see it in the gui log if nothing else.
Gotcha, I didn't realize that wasn't the whole check. I assume you don't want the whole thing so I grabbed the beginning and one of the comics it should be able to find.
03-Dec-2015 09:34:14 - INFO :: CP Server Thread-6 : Attempting to run RSS Check Forcibly 03-Dec-2015 09:34:14 - INFO :: Thread-14 : RSS Feed Check was last run at : 2015-12-03 09:31:28 03-Dec-2015 09:34:14 - INFO :: Thread-14 : RSS Feed Check First Ever Run. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Updating RSS Run time to : 2015-12-03 09:34:14 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] Initiating Torrent RSS Check. 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] Initiating Torrent RSS Feed Check on KAT. 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [KAT] there were 0 results from the New Releases RSS Feed for comics 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Completed adding new data to RSS DB. Next add in 20 minutes 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [KAT] there were 0 results from the New Releases for category Other RSS Feed that contain comics 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Completed adding new data to RSS DB. Next add in 20 minutes 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] Initiating RSS Feed Check for NZB Providers. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : [RSS] You have enabled 0 NZB RSS search providers. 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] RSS Feed Check/Update Complete 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] Watchlist Check for new Releases 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Initiating Search Scan at scheduled interval of 20 minutes. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Publisher is : DC Comics 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Issue Title given as : race of thieves, part 4: a cold case 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Checking for torrent enabled. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : nzbprovider(s): [] 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : there are : 1 torrent providers you have selected. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : there are : 0 nzb providers you have selected. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Usenet Retention : 1500 days 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : found provider in existing enabled providers. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : checking against torrent provider: kat 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : torrent provider found: kat 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : provider order sequence is now to start with kat at spot #0 03-Dec-2015 09:34:14 - INFO :: Thread-14 : search provider order is ['kat'] 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Initiating Search via : rss 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Shhh be very quiet...I'm looking for Catwoman issue: 33 (2014) using KAT [RSS] 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : calpha/cnumber: None / None 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : RSS Check: yes 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : nzbprov: KAT 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : comicid: 42722 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Sending request to [KAT] RSS for Catwoman : 033 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : ComicID: 42722 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : tsearch : catwoman% 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : seriesname_alt:None 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : RSS Check: yes 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : nzbprov: KAT 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : comicid: 42722 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Sending request to [KAT] RSS for Catwoman : 33 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : ComicID: 42722 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : tsearch : catwoman% 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : seriesname_alt:None 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Could not find Issue 33 of Catwoman(2011) using KAT [rss] 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Finished searching via :rss. Issue not found - status kept as Wanted.
On Thu, Dec 3, 2015 at 8:49 AM, evilhero notifications@github.com wrote:
That's not the actual portion of the check I was thinking of - it's the very start of the rss check and starts with [RSS] Initiating Forced RSS Check.'
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161644919.
-Chris Etheridge
Just as a test I pulled an RSS feed from KAT and that is working as well (just to eliminate the possibility). I used https://kat.cr/comics/?rss=1
On Thu, Dec 3, 2015 at 9:37 AM, Chris Etheridge < christopher.etheridge@gmail.com> wrote:
Gotcha, I didn't realize that wasn't the whole check. I assume you don't want the whole thing so I grabbed the beginning and one of the comics it should be able to find.
03-Dec-2015 09:34:14 - INFO :: CP Server Thread-6 : Attempting to run RSS Check Forcibly 03-Dec-2015 09:34:14 - INFO :: Thread-14 : RSS Feed Check was last run at : 2015-12-03 09:31:28 03-Dec-2015 09:34:14 - INFO :: Thread-14 : RSS Feed Check First Ever Run. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Updating RSS Run time to : 2015-12-03 09:34:14 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] Initiating Torrent RSS Check. 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] Initiating Torrent RSS Feed Check on KAT. 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [KAT] there were 0 results from the New Releases RSS Feed for comics 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Completed adding new data to RSS DB. Next add in 20 minutes 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [KAT] there were 0 results from the New Releases for category Other RSS Feed that contain comics 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Completed adding new data to RSS DB. Next add in 20 minutes 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] Initiating RSS Feed Check for NZB Providers. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : [RSS] You have enabled 0 NZB RSS search providers. 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] RSS Feed Check/Update Complete 03-Dec-2015 09:34:14 - INFO :: Thread-14 : [RSS] Watchlist Check for new Releases 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Initiating Search Scan at scheduled interval of 20 minutes. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Publisher is : DC Comics 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Issue Title given as : race of thieves, part 4: a cold case 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Checking for torrent enabled. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : nzbprovider(s): [] 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : there are : 1 torrent providers you have selected. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : there are : 0 nzb providers you have selected. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Usenet Retention : 1500 days 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : found provider in existing enabled providers. 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : checking against torrent provider: kat 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : torrent provider found: kat 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : provider order sequence is now to start with kat at spot #0 03-Dec-2015 09:34:14 - INFO :: Thread-14 : search provider order is ['kat'] 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Initiating Search via : rss 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Shhh be very quiet...I'm looking for Catwoman issue: 33 (2014) using KAT [RSS] 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : calpha/cnumber: None / None 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : RSS Check: yes 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : nzbprov: KAT 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : comicid: 42722 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Sending request to [KAT] RSS for Catwoman : 033 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : ComicID: 42722 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : tsearch : catwoman% 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : seriesname_alt:None 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : RSS Check: yes 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : nzbprov: KAT 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : comicid: 42722 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : Sending request to [KAT] RSS for Catwoman : 33 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : ComicID: 42722 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : tsearch : catwoman% 03-Dec-2015 09:34:14 - DEBUG :: Thread-14 : seriesname_alt:None 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Could not find Issue 33 of Catwoman(2011) using KAT [rss] 03-Dec-2015 09:34:14 - INFO :: Thread-14 : Finished searching via :rss. Issue not found - status kept as Wanted.
On Thu, Dec 3, 2015 at 8:49 AM, evilhero notifications@github.com wrote:
That's not the actual portion of the check I was thinking of - it's the very start of the rss check and starts with [RSS] Initiating Forced RSS Check.'
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161644919.
-Chris Etheridge
-Chris Etheridge
Ok, now that's got me stumped - as the feed itself says it returned 0 hits, which would mean it's not successfully hitting the feed from within Mylar for some reason.
Are you running Mylar through a third-party app of some kind, or installed Mylar as a plugin (like the SynoPkg one for Synology users,etc) - basically installed it any other way than from source/git?
One other thing, on the first tab of the configuration - it shows what your running against Mylar...can you verify that it's using the correct python version?
It is a QNAP package, which is probably where the problem lies, I wouldn't doubt that, but the first tab does say python 2.7.9. I am not familiar enough with the QNAP system to install it manually, I guess I have some homework to do. Although I am using the most current package, I am surprised that no one else is having the issue.
On Thu, Dec 3, 2015 at 1:22 PM, evilhero notifications@github.com wrote:
Ok, now that's got me stumped - as the feed itself says it returned 0 hits, which would mean it's not successfully hitting the feed from within Mylar for some reason.
Are you running Mylar through a third-party app of some kind, or installed Mylar as a plugin (like the SynoPkg one for Synology users,etc) - basically installed it any other way than from source/git?
One other thing, on the first tab of the configuration - it shows what your running against Mylar...can you verify that it's using the correct python version?
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161738256.
-Chris Etheridge
I'm honestly not sure if there's any known problems with the QNAP package, as I don't have anything to do with it so it's kind of hard for me to offer support for it.
If you were able to run it from a command line instead of through the pkg manager (I'm assuming that's how you run it), it might give a better indication of an error in the console that might be supressed when it's running as a daemon.
I tried that and the only error that I can see is the following:
03-Dec-2015 22:31:54 - ERROR :: MAIN : No User Comicvine API key specified. I will not work very well due to api limits - http://api.comicvine.com/ and get your own free key.
Interesting because I have a key and it is entered in the settings and also the config.ini.
On Thu, Dec 3, 2015 at 9:52 PM, evilhero notifications@github.com wrote:
I'm honestly not sure if there's any known problems with the QNAP package, as I don't have anything to do with it so it's kind of hard for me t offer support for it.
If you were able to run it from a command line instead of through the pkg manager (I'm assuming that's how you run it), it might give a better indication of an error that might be supressed when it's running as a daemon.
— Reply to this email directly or view it on GitHub https://github.com/evilhero/mylar/issues/1172#issuecomment-161857518.
-Chris Etheridge
That's probably due to the way the QNAP pkg is installed - alot of the 3rd party packages for different NAS systems move mylar's program and data directories into another location, as well as the config.ini and mylar.db files.
All of the options can be specified via the command line, but you'd need to know what location the files are in (or if you could find out what command line the pkg is running that would work too).
Without specifying the proper locations that you already have setup, Mylar assumes they are in the default location, which on your system given the QNAP pkg install, they're not there.
So I have finally had time to look into this issue again. I figured out hoe to get Python 2.7.11 running with Mylar. I still get the 0 results message from KAT.
According to your last message, would you like for me to post the contents of the Mylar.sh file that is starting the pkg on my QNAP?
Sure it doesn't hurt to see if that might be causing some issue. There's been a bunch a few commits to the development branch since the last post in here - night want to make sure you're running the latest development commit as well.
Sorry for the delay. Here is the script that starts Mylar. Thanks again for your time!
Mylar.sh
QPKG_NAME=Mylar QPKG_DIR=$(/sbin/getcfg $QPKG_NAME Install_Path -f /etc/config/qpkg.conf) PID_FILE="$QPKG_DIR/config/mylar.pid"
DAEMON_OPTS="Mylar.py -d --datadir $QPKG_DIR/config --config $QPKG_DIR/config/config.ini --pidfile $PID_FILE"
ver="none" if /bin/uname -m | grep "armv5tejl"; then ver="arm"; fi if /bin/uname -m | grep "armv5tel"; then ver="arm"; fi if /bin/uname -m | grep "i686"; then ver="x86"; fi if /bin/uname -m | grep "x86_64"; then ver="x86"; fi if /bin/uname -m | grep "armv7l"; then ver="x31"; fi arch="$(/bin/uname -m)" [ $ver = "none" ] && err_log "Could not determine architecture $arch" export PATH=${QPKG_DIR}/${ver}/bin-utils:/Apps/bin:/usr/local/bin:$PATH
CheckQpkgEnabled() { #Is the QPKG enabled? if not exit the script
if [ $(/sbin/getcfg ${QPKG_NAME} Enable -u -d FALSE -f /etc/config/qpkg.conf) = UNKNOWN ]; then
/sbin/setcfg ${QPKG_NAME} Enable TRUE -f /etc/config/qpkg.conf
elif [ $(/sbin/getcfg ${QPKG_NAME} Enable -u -d FALSE -f /etc/config/qpkg.conf) != TRUE ]; then
/bin/echo "${QPKG_NAME} is disabled."
exit 1
fi
if [ /sbin/getcfg "git" Enable -u -d FALSE -f /etc/config/qpkg.conf
= UNKNOWN ]; then
/sbin/setcfg "git" Enable TRUE -f /etc/config/qpkg.conf
elif [ /sbin/getcfg "git" Enable -u -d FALSE -f /etc/config/qpkg.conf
!= TRUE ]; then
echo "git is disabled."
exit 1
fi
/sbin/getcfg "Python" Enable -u -d FALSE -f /etc/config/qpkg.conf
= UNKNOWN ]; then# /sbin/setcfg "Python" Enable TRUE -f /etc/config/qpkg.conf
#elif [ `/sbin/getcfg "Python" Enable -u -d FALSE -f /etc/config/qpkg.conf` != TRUE ]; then
# echo "Python is disabled."
# exit 1
#fi
[ -x /Apps/bin/git ] || /etc/init.d/git.sh restart && sleep 2
#[ -x $DAEMON ] || /etc/init.d/python.sh restart && sleep 2
}
ConfigPython(){ #checks if the daemon exists and will link /usr/bin/python to it
VER=0
DAEMON="None"
for DAEMON2 in /usr/bin/python2.7 /usr/local/bin/python2.7 /opt/bin/python2.7 /Apps/opt/bin/python2.7 /opt/QPython2/bin/python2.7
do
echo "Looking for $DAEMON2"
[ ! -x $DAEMON2 ] && continue
VER2=$(expr substr "$(${DAEMON2} -V 2>&1)" 8 8)
if [ $VER2 > $VER ]; then
DAEMON=$DAEMON2
VER=$VER2
fi
done
if [ ! -x $DAEMON ]; then
/sbin/write_log "Failed to start $QPKG_NAME, $DAEMON was not found. Please re-install the Pythton qpkg." 1
exit 1
else
/bin/echo "Found Python Version ${VER} at ${DAEMON}"
fi
}
CheckForGit(){ #Does git exist?
/bin/echo -n " Checking for git..."
if [ ! -f /Apps/bin/git ]; then
if [ -x /etc/init.d/git.sh ]; then
/bin/echo " Starting git..."
/etc/init.d/git.sh start
sleep 2
else #catch all
/bin/echo " No git qpkg found, please install it"
/sbin/write_log "Failed to start $QPKG_NAME, no git found." 1
exit 1
fi
else
/bin/echo " Found!"
fi
}
CheckQpkgRunning() { #Is the QPKG already running? if so, exit the script if [ -f $PID_FILE ]; then
Pid=$(/bin/cat $PID_FILE)
if [ -d /proc/$Pid ]; then
/bin/echo " $QPKG_NAME is already running"
exit 1
fi
fi
#ok, we survived so the QPKG should not be running
}
UpdateQpkg(){ # does a git pull to update to the latest code /bin/echo "Updating $QPKG_NAME" GIT_URL=git://github.com/evilhero/mylar.git GIT_URL1="http://github.com/evilhero/mylar.git"
[ -d $QPKG_DIR/$QPKG_NAME/.git ] || git clone $GIT_URL $QPKG_DIR/$QPKG_NAME || git clone $GIT_URL1 $QPKG_DIR/$QPKG_NAME
cd $QPKG_DIR/$QPKG_NAME && git reset --hard HEAD && git pull && /bin/sync
}
StartQpkg(){ /bin/echo "Starting $QPKG_NAME" cd $QPKG_DIR/$QPKG_NAME PATH=${PATH} ${DAEMON} ${DAEMON_OPTS} }
ShutdownQPKG() { #kills a proces based on a PID in a given PID file /bin/echo "Shutting down ${QPKG_NAME}... " if [ -f $PID_FILE ]; then
Pid=$(/bin/cat $PID_FILE)
i=0
/bin/kill $Pid
/bin/echo -n " Waiting for ${QPKG_NAME} to shut down: "
while [ -d /proc/$Pid ]; do
sleep 1
let i+=1
/bin/echo -n "$i, "
if [ $i = 45 ]; then
/bin/echo " Tired of waiting, killing ${QPKG_NAME} now"
/bin/kill -9 $Pid
/bin/rm -f $PID_FILE
exit 1
fi
done
/bin/rm -f $PID_FILE
/bin/echo "Done"
else
/bin/echo "${QPKG_NAME} is not running?"
fi
}
case "$1" in start) CheckQpkgEnabled #Check if the QPKG is enabled, else exit /bin/echo "$QPKG_NAME prestartup checks..." CheckQpkgRunning #Check if the QPKG is not running, else exit CheckForGit #Check for git, start qpkg if needed ConfigPython #Check for Python, exit if not found UpdateQpkg #do a git pull StartQpkg #Finally Start the qpkg
;;
stop) ShutdownQPKG ;; restart) echo "Restarting $QPKG_NAME" $0 stop $0 start ;; *) N=/etc/init.d/$QPKG_NAME.sh echo "Usage: $N {start|stop|restart}" >&2 exit 1 ;; esac
There is apparently a lite version of python in the qnap repository and that causes some problems with apps like mylar.
I believe the full pkg is python 2.7.9.5 from what I remember in another thread on the forums.
The shell script that runs that you just posted, it generates a log when it runs... Can you post the results of that?
I was running their official 2.7.3 package, which I thought was the initial problem. I upgraded to the 2.7.9.5 package which had the same problems, currently I am running a package that has only been posted to the forums which is 2.7.11.0. They have added quite a few modules and addons. Qnap doesn't seem to be interested in updating the packages in their official repository. The link to the package is here: http://forum.qnap.com/viewtopic.php?f=217&t=109899&hilit=qpython
As far as the log goes, I could be wrong, but it appears that it is just writing to the main system log. Under the system log, I only see that I stopped and started Mylar but no extra information. When I run Mylar from the command line, it says:
[/share/CACHEDEV1_DATA/.qpkg/Mylar] # sh Mylar.sh start x86_64 Mylar prestartup checks... Checking for git... Found! Looking for /usr/bin/python2.7 Looking for /usr/local/bin/python2.7 Looking for /opt/bin/python2.7 Looking for /Apps/opt/bin/python2.7 Looking for /opt/QPython2/bin/python2.7 Found Python Version 2.7.11 at /opt/QPython2/bin/python2.7 Updating Mylar HEAD is now at bbcd4ea FIX:(#1201) Another attempt to get mylar to pass the properly formatted paths to CT when Meta-Tagging Already up-to-date. Starting Mylar 20-Feb-2016 11:09:59 - INFO :: MainThread : [DIRECTORY-CHECK] Found comic directory: /share/CACHEDEV1_DATA/.qpkg/Mylar/config 20-Feb-2016 11:09:59 - INFO :: MAIN : Successfully discovered local IP and locking it in as : 192.168.1.24 20-Feb-2016 11:09:59 - INFO :: MAIN : Branch detected & set to : development 20-Feb-2016 11:09:59 - INFO :: MAIN : [DB Module] Loading : sqlite3 as the database module to use. 20-Feb-2016 11:09:59 - INFO :: MAIN : Checking to see if the database has all tables.... 20-Feb-2016 11:09:59 - ERROR :: MAIN : Could not locate exceptions.csv file. Make sure it is in datadir: /share/CACHEDEV1_DATA/.qpkg/Mylar/config 20-Feb-2016 11:09:59 - INFO :: MAIN : Ensuring DB integrity - Removing all Erroneous Comics (ie. named None) 20-Feb-2016 11:09:59 - INFO :: MAIN : Correcting Null entries that make the main page break on startup. 20-Feb-2016 11:09:59 - INFO :: MAIN : Retrieving latest version information from github 20-Feb-2016 11:10:00 - INFO :: MAIN : Mylar is up to date 20-Feb-2016 11:10:00 - INFO :: MAIN : Remapping the sorting to allow for new additions. 20-Feb-2016 11:10:00 - INFO :: MAIN : Sucessfully ordered 60 series in your watchlist.
So I think the problem is that it's using qpython and not a normal version of python. I read a forum post (or several) the had indicated that switching to the Entware version of python solved some strange issues with users who were using qpython.
I'm not sure what is not included in the qpython, but here's the instruction link for entropy in case you wanted to read it: http://forum.qnap.com/viewtopic.php?f=223&t=118366&p=525858#p525858
I just don't get it... I uninstalled Qpython and installed the Entware version... Same thing:
2016-02-20 14:32:40 INFO [KAT] there were 0 results..
Are you sure that you can reach https://kat.cr from a browser on the same machine that Mylar is on?
[/share/CACHEDEV1_DATA/Download] # wget https://kat.cr --2016-02-21 06:17:49-- https://kat.cr/ Resolving kat.cr (kat.cr)... 192.99.233.14, 192.99.147.54, 192.99.147.51, ... Connecting to kat.cr (kat.cr)|192.99.233.14|:443... connected. ERROR: cannot verify kat.cr's certificate, issued by ‘/C=GB/ST=Greater Manchester/L=Salford/O=COMODO CA Limited/CN=COMODO RSA Domain Validation Secure Server CA’: Self-signed certificate encountered. To connect to kat.cr insecurely, use `--no-check-certificate'. [/share/CACHEDEV1_DATA/Download] # wget https://kat.cr --no-check-certificate --2016-02-21 06:18:27-- https://kat.cr/ Resolving kat.cr (kat.cr)... 192.99.233.14, 192.99.147.54, 192.99.147.51, ... Connecting to kat.cr (kat.cr)|192.99.233.14|:443... connected. WARNING: cannot verify kat.cr's certificate, issued by ‘/C=GB/ST=Greater Manchester/L=Salford/O=COMODO CA Limited/CN=COMODO RSA Domain Validation Secure Server CA’: Self-signed certificate encountered. HTTP request sent, awaiting response... 200 OK Length: unspecified [text/html] Saving to: ‘index.html’
index.html [ <=> ] 2.64K --.-KB/s in 0s
2016-02-21 06:18:27 (56.9 MB/s) - ‘index.html’ saved [2707]
OK so with that it looks like the feedparser module doesn't support self signed certificates, and is causing some issues. Albeit then the actual downloading of the torrent should work but you can't get that far yet. I have a fix coming that let's you specify certificate validation on each provider within mylar, so hopefully that will fix the issue.
You could try something in the meantime tho... With mylar shutdown, edit the config.ini and for kat_proxy put in the non-https url for Kat (ie. kat_proxy = http://kat.cr). Save the config and start mylar up and see if that bypasses the verification check.
Yeah, I was one step ahead of you. I thought about the message and read a couple of forums thinking the same thing. I tried adding the non-http site and it still didn't work. I wonder if there is something forcing the site to go to https...
Well the feedparser that's in mylar and is used to read the results from both the rss feeds and backlog for Kat doesn't support self-signed certificates.
If you put in a non-https entry for the kat_proxy (with mylar turned off), it should be calling the non-https version for both the feeds and backlog searches and getting some kind of result when it starts back up.
Maybe try a different kat_proxy, there are several out there but you need to make sure the one you do pick supports search responses in an rss format (basically if you do a search on the website, you'll see an rss icon in the search results page that brings you to the results but in an rss format that's used for parsing). I believe one site that I've used before for testing and worked was http://katproxy.me (scratch that...that one's dead)
Ability to specify ssl certificate verification for KAT is now live in the development build (config.ini: kat_verify = 0 to disable verification, kat_verify = 1 to enable verification).
I also changed out the feedparser so that it uses the requests module, which has better http/https handling so it should alleivate the problems you're having (hopefully).
Please let me know if things are working for you or not with this latest commit
You are a genius sir! It is working again. Thank you for so much your patience and for working on this. I did note one thing. In the config, instead of the default option being kat_verify = 1 it was kat_verify = True. So I made it False instead of 0. I assume python reads it as a boolean value either way.
I wish QNAP would get their crap together and have some actual root certificates to check against as I read several forums where multiple apps are having a similar issue. I will at least update my posts on the QNAP Mylar forum with this fix as I guess that others have the same issue. Thanks again!
Glad it's working for you again :)
I'll check into how mylar is storing the kat_verify - it should be the numeric, as during the search process Mylar takes the boolean value of it. It's very possible I missed something during the coding, and accidentally left it as a boolean (it should work regardless, but it's good for consistency).
Cheers!
I don't see any particular errors other than it not finding anything from KAT at all. I have confirmed that I can get to KAT and search for issues manually and I can find them. Here is a snippet of the log. Forgive me if this is the wrong one. Not sure what is needed to troubleshoot:
01-Dec-2015 15:50:36 - DEBUG :: SEARCH : RSS Check: yes 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : nzbprov: KAT 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : comicid: 26611 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : Sending request to [KAT] RSS for Chew : 52 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : ComicID: 26611 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : tsearch : chew% 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : seriesname_alt:None 01-Dec-2015 15:50:36 - INFO :: SEARCH : Could not find Issue 52 of Chew(2009) using KAT [rss] 01-Dec-2015 15:50:36 - INFO :: SEARCH : Finished searching via :rss. Issue not found - status kept as Wanted. 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : Initiating Search via : api 01-Dec-2015 15:50:36 - INFO :: SEARCH : Shhh be very quiet...I'm looking for Chew issue: 52 (2015) using KAT 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : calpha/cnumber: None / None 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : RSS Check: None 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : nzbprov: KAT 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : comicid: 26611 01-Dec-2015 15:50:36 - DEBUG :: SEARCH : Sending request to [KAT] for chew : 052 01-Dec-2015 15:50:36 - INFO :: SEARCH : [KAT] there were 0 results.. 01-Dec-2015 15:50:37 - INFO :: SEARCH : [KAT] there were 0 results.. 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : RSS Check: None 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : nzbprov: KAT 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : comicid: 26611 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : Sending request to [KAT] for chew : 52 01-Dec-2015 15:50:37 - INFO :: SEARCH : [KAT] there were 0 results.. 01-Dec-2015 15:50:37 - INFO :: SEARCH : [KAT] there were 0 results.. 01-Dec-2015 15:50:37 - INFO :: SEARCH : Could not find Issue 52 of Chew(2009) using KAT [api] 01-Dec-2015 15:50:37 - INFO :: SEARCH : Finished searching via :api. Issue not found - status kept as Wanted. 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : Publisher is : Image 01-Dec-2015 15:50:37 - INFO :: SEARCH : Issue Title given as : chapter thirty-one 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : Checking for torrent enabled. 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : nzbprovider(s): [] 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : there are : 1 torrent providers you have selected. 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : there are : 0 nzb providers you have selected. 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : Usenet Retention : 1500 days 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : found provider in existing enabled providers. 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : checking against torrent provider: kat 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : torrent provider found: kat 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : provider order sequence is now to start with kat at spot #0 01-Dec-2015 15:50:37 - INFO :: SEARCH : search provider order is ['kat'] 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : Initiating Search via : rss 01-Dec-2015 15:50:37 - INFO :: SEARCH : Shhh be very quiet...I'm looking for Saga issue: 31 (2015) using KAT [RSS] 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : calpha/cnumber: None / None 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : RSS Check: yes 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : nzbprov: KAT 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : comicid: 46568 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : Sending request to [KAT] RSS for Saga : 031 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : ComicID: 46568 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : tsearch : saga% 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : seriesname_alt:None 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : RSS Check: yes 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : nzbprov: KAT 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : comicid: 46568 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : Sending request to [KAT] RSS for Saga : 31 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : ComicID: 46568 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : tsearch : saga% 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : seriesname_alt:None 01-Dec-2015 15:50:37 - INFO :: SEARCH : Could not find Issue 31 of Saga(2012) using KAT [rss] 01-Dec-2015 15:50:37 - INFO :: SEARCH : Finished searching via :rss. Issue not found - status kept as Wanted. 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : Initiating Search via : api 01-Dec-2015 15:50:37 - INFO :: SEARCH : Shhh be very quiet...I'm looking for Saga issue: 31 (2015) using KAT 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : calpha/cnumber: None / None 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : RSS Check: None 01-Dec-2015 15:50:37 - DEBUG :: SEARCH : nzbprov: KAT