CP failing / nzbToCouchPotato.py - KeyError: 'status'

[Scoobdriver]

halted on auto call to TorrentToMedia.py so ran nzbToCouchPotato.py

and get the following error

11:53:15 INFO:: Loading config from /volume1/git/dev/nzbToMedia/autoProcessMedia.cfg 11:53:15 INFO:: Checking if git needs an update 11:53:16 INFO:: No update needed 11:53:16 INFO:: nzbToMedia Version:4935e4b1c10c8112af560a055bf3384d7701ae46 Branch:dev (Linux 3.2.40) 11:53:16 POSTPROCESS:: ######################################################### 11:53:16 POSTPROCESS:: ## ..::[nzbToMedia]::.. :: STARTING 11:53:16 POSTPROCESS:: ######################################################### 11:53:16 WARNING:: Invalid number of arguments received from client, Switching to manual run mode ... 11:53:16 POSTPROCESS:: nzbToMedia NzbDrone:tv is DISABLED, you can enable this in autoProcessMedia.cfg ... 11:53:16 POSTPROCESS:: nzbToMedia CouchPotato:movie is DISABLED, you can enable this in autoProcessMedia.cfg ... 11:53:16 POSTPROCESS:: nzbToMedia running CouchPotato:movies as a manual run on folder /volume3/Download/movies/cp.(tt2172985) ... 11:53:16 POSTPROCESS:: Calling CouchPotatoServer to post-process: cp.(tt2172985) 11:53:16 POSTPROCESS:: ######################################################### 11:53:16 POSTPROCESS:: ## ..::[CouchPotato]::.. :: CATEGORY:[movies] 11:53:16 POSTPROCESS:: ######################################################### Traceback (most recent call last): File "nzbToCouchPotato.py", line 139, in exit(main()) File "nzbToCouchPotato.py", line 136, in main nzbToMedia.main() File "/volume1/git/dev/nzbToMedia/nzbToMedia.py", line 431, in main results = process(dirName, os.path.basename(dirName), 0, inputCategory=category) File "/volume1/git/dev/nzbToMedia/nzbToMedia.py", line 309, in process result = autoProcessMovie().process(nzbDir, inputName, status, clientAgent, download_id, inputCategory) File "/volume1/git/dev/nzbToMedia/nzbtomedia/autoProcess/autoProcessMovie.py", line 169, in process media_id, download_id, release_id, release_status, downloader = self.find_release_info(baseURL, download_id, dirName, nzbName, clientAgent) File "/volume1/git/dev/nzbToMedia/nzbtomedia/autoProcess/autoProcessMovie.py", line 86, in find_release_info matched_release = search_results(results, clientAgent) File "/volume1/git/dev/nzbToMedia/nzbtomedia/autoProcess/autoProcessMovie.py", line 65, in search_results if release['status'] != 'snatched': KeyError: 'status'

[clinton-hall]

Do you have logs from the TorrentToMedia event that halted?

[Scoobdriver]

first one was wrong... here it is

2014-04-16 11:49:08 INFO :: Loading config from /volume1/git/dev/nzbToMedia/autoProcessMedia.cfg 2014-04-16 11:49:08 INFO :: Checking if git needs an update 2014-04-16 11:49:09 INFO :: No update needed 2014-04-16 11:49:09 INFO :: nzbToMedia Version:4935e4b1c10c8112af560a055bf3384d7701ae46 Branch:dev (Linux 3.2.40) 2014-04-16 11:49:09 POSTPROCESS:: ######################################################### 2014-04-16 11:49:09 POSTPROCESS:: ## ..::[TorrentToMedia]::.. :: STARTING 2014-04-16 11:49:09 POSTPROCESS:: ######################################################### 2014-04-16 11:49:09 INFO :: SEARCH: Found torrent directory The Art of the Steal (2013) in input directory directory /volume3/Download/movies/cp.(tt2172985) 2014-04-16 11:49:09 INFO :: SEARCH: Setting inputDirectory to /volume3/Download/movies/cp.(tt2172985)/The Art of the Steal (2013) 2014-04-16 11:49:14 POSTPROCESS:: Output directory set to: /volume3/Download/Processing/movies/The Art of the Steal (2013) 2014-04-16 11:49:14 INFO :: CREATE DESTINATION: Creating destination folder: /volume3/Download/Processing/movies/The Art of the Steal (2013) 2014-04-16 11:49:14 INFO :: COPYLINK: Hard linking /volume3/Download/movies/cp.(tt2172985)/The Art of the Steal (2013)/WWW.YIFY-TORRENTS.COM.jpg to /volume3/Download/Processing/movies/The Art of the Steal (2013)/WWW.YIFY-TORRENTS.COM.jpg 2014-04-16 11:49:14 INFO :: COPYLINK: Hard linking /volume3/Download/movies/cp.(tt2172985)/The Art of the Steal (2013)/The.Art.of.the.Steal.2013.720p.BluRay.x264.YIFY.mp4 to /volume3/Download/Processing/movies/The Art of the Steal (2013)/The.Art.of.the.Steal.2013.720p.BluRay.x264.YIFY.mp4 2014-04-16 11:49:14 INFO :: FLATTEN: Flattening directory: /volume3/Download/Processing/movies/The Art of the Steal (2013) 2014-04-16 11:49:14 INFO :: REMOVER: Removing empty folders in: /volume3/Download/Processing/movies/The Art of the Steal (2013) 2014-04-16 11:49:14 POSTPROCESS:: Calling CouchPotato:movies to post-process: The Art of the Steal (2013) 2014-04-16 11:49:14 POSTPROCESS:: ######################################################### 2014-04-16 11:49:14 POSTPROCESS:: ## ..::[CouchPotato]::.. :: CATEGORY:[movies] 2014-04-16 11:49:14 POSTPROCESS:: #########################################################

[echel0n]

my guess is its not finding a matched_release so release['status'] would return a key_error.

I'll add in more error checks to avoid this and post back.

[Scoobdriver]

I used a cp tag in the folder name cp.(ttxxxxx), which CP used to use to identify the release I believe, if it had not "snatched" it itself..

Regards

On 16 April 2014 14:50, echel0n notifications@github.com wrote:

my guess is its not finding a matched_release so release['status'] would return a key_error.

I'll add in more error checks to avoid this and post back.

— Reply to this email directly or view it on GitHubhttps://github.com/clinton-hall/nzbToMedia/issues/330#issuecomment-40600552 .

[echel0n]

Ok that would cause issues right there, if the release is NOT snatched by CP first then there is no way for us to get the release status and confirm if it changes later on. So even if I do add in checks to confirm this it'll still not post-process cause thats not how this is supposed to work.

[Scoobdriver]

can it exit gracefully ?

[echel0n]

Thats what I'm attempting right now, what did you do to originally cause the error ? just created a folder with cp.IMDBID ?

[Scoobdriver]

status was wanted in CP , however CP had not snatched a release. I manual added torrent with the cp.(ttIMDB) tag as this used to work in nzbtoMedia it would call couch potato and it would match and process it.. It also failed on a manual run .

[echel0n]

maybe cause it would send CP just the folder to be processed but why not snatch it from CP ?

[Scoobdriver]

BTW when I sent a manual force processed renamer.scan command to CP it was identified and processed..

[echel0n]

ok I can do that if you want ... no big issue I just send in the folder to be scanned if no download_id found

[echel0n]

Is there a reason you create the folder name with cp.(tt2172985) instead of cp(tt2172985) minus the DOT

[Scoobdriver]

no .. I think it should be without the dot ie cp(ttxxxxxxx) think its worked both ways in past for me..

[echel0n]

Ok I'm creating a better way of pullimg imdbID from nzbName or dirName so that we can properly use this to determine other info we need during a manual run, give me a few minutes and Ill have a update for you to test :)

[echel0n]

OK I've merged in my changes to DEV so please update and let me know if this resolves your issue, thanks.

[Scoobdriver]

Thanks :) will try

On 16 April 2014 15:52, echel0n notifications@github.com wrote:

OK I've merged in my changes to DEV so please update and let me know if this resolves your issue, thanks.

— Reply to this email directly or view it on GitHubhttps://github.com/clinton-hall/nzbToMedia/issues/330#issuecomment-40608257 .

[echel0n]

It should send the folder to CP to be post-processed by renamer without issue but it won't be able to confirm a status change so that is on you to manually confirm if in fact this has been processed by CP. Thats the best I can do right now without re-working a loop into it or something to confirm its been added to CP's database.

[echel0n]

Actually knowing the imdbID I should be able to confirm it is in the DB via a loop and return true/false as to if its been added after a period of time has elapsed. Let me dive further into this as I hate not having this fully automated lol

[echel0n]

Ok it should be fully automated now so please try new updated DEV branch and confirm if this is now working the way you requested, thanks.

[Scoobdriver]

Now receiving KeyError: '_id'

Logs on Transmission call

2014-04-18 13:59:56 POSTPROCESS:: ######################################################### 2014-04-18 13:59:56 POSTPROCESS:: ## ..::[/volume1/git/dev/nzbToMedia/TorrentToMedia.py]::.. CLIENT:transmission ## STARTING 2014-04-18 13:59:56 POSTPROCESS:: ######################################################### 2014-04-18 13:59:56 DEBUG :: Options passed into TorrentToMedia: ['/volume1/git/dev/nzbToMedia/TorrentToMedia.p y'] 2014-04-18 13:59:56 DEBUG :: Received Directory: /volume3/Download/movies | Name: The Machine (2013) 720p BluRa y [G2G] | Category: 2014-04-18 13:59:56 DEBUG :: SEARCH: Found Category: movies in directory structure 2014-04-18 13:59:56 INFO :: SEARCH: Found torrent directory The Machine (2013) 720p BluRay [G2G] in input dire ctory directory /volume3/Download/movies 2014-04-18 13:59:56 INFO :: SEARCH: Setting inputDirectory to /volume3/Download/movies/The Machine (2013) 720p BluRay [G2G] 2014-04-18 13:59:56 DEBUG :: Determined Directory: /volume3/Download/movies/The Machine (2013) 720p BluRay [G2G ] | Name: The Machine (2013) 720p BluRay [G2G] | Category: movies 2014-04-18 13:59:56 DEBUG :: Connecting to transmission: http://localhost:9091 2014-04-18 13:59:56 DEBUG :: Stoping torrent The Machine (2013) 720p BluRay [G2G] in transmission while process ing 2014-04-18 14:00:01 POSTPROCESS:: Output directory set to: /volume3/Download/Processing/movies/The Machine (2013) 720p BluRay [G2G] 2014-04-18 14:00:01 DEBUG :: Scanning files in directory: /volume3/Download/movies/The Machine (2013) 720p BluR ay [G2G] 2014-04-18 14:00:01 DEBUG :: Found 2 files in /volume3/Download/movies/The Machine (2013) 720p BluRay [G2G] 2014-04-18 14:00:01 INFO :: COPYLINK: Hard linking /volume3/Download/movies/The Machine (2013) 720p BluRay [G2 G]/The Machine [G2G].jpg to /volume3/Download/Processing/movies/The Machine (2013) 720p BluRay [G2G]/The Machine [G2G].jpg 2014-04-18 14:00:01 INFO :: COPYLINK: Hard linking /volume3/Download/movies/The Machine (2013) 720p BluRay [G2 G]/The Machine (2013) 720p BluRay [G2G].mp4 to /volume3/Download/Processing/movies/The Machine (2013) 720p BluRay [G2G]/The Machine (2013) 720p BluRay [G2G].mp4 2014-04-18 14:00:01 INFO :: FLATTEN: Flattening directory: /volume3/Download/Processing/movies/The Machine (20 13) 720p BluRay [G2G] 2014-04-18 14:00:01 INFO :: REMOVER: Removing empty folders in: /volume3/Download/Processing/movies/The Machin e (2013) 720p BluRay [G2G] 2014-04-18 14:00:01 DEBUG :: Found media file: /volume3/Download/Processing/movies/The Machine (2013) 720p BluR ay [G2G]/The Machine (2013) 720p BluRay [G2G].mp4 2014-04-18 14:00:01 DEBUG :: Found 1 media files 2014-04-18 14:00:01 DEBUG :: Calling autoProcess script for successful download. 2014-04-18 14:00:01 POSTPROCESS:: Calling CouchPotato:movies to post-process: The Machine (2013) 720p BluRay [G2G ] 2014-04-18 14:00:01 POSTPROCESS:: ######################################################### 2014-04-18 14:00:01 POSTPROCESS:: ## ..::[CouchPotato]::.. :: CATEGORY:[movies] 2014-04-18 14:00:01 POSTPROCESS:: ######################################################### 2014-04-18 14:00:01 DEBUG :: Opening URL: http://www.omdbapi.com 2014-04-18 14:00:01 DEBUG :: Opening URL: http://localhost:5053/api/snip/media.list 2014-04-18 14:00:01 ERROR :: Could not find any releases marked as WANTED on CouchPotato to compare changes aga inst The Machine (2013) 720p BluRay [G2G], skipping ... 2014-04-18 14:00:01 ERROR :: A problem was reported in the autoProcess* script. If torrent was paused we will r esume seeding 2014-04-18 14:00:01 DEBUG :: Starting torrent The Machine (2013) 720p BluRay [G2G] in transmission 2014-04-18 14:00:06 ERROR :: A problem was reported in the /volume1/git/dev/nzbToMedia/TorrentToMedia.py script

on a manual nzbtocouch call

14:22:57 POSTPROCESS:: ######################################################### 14:22:57 POSTPROCESS:: ## ..::[CouchPotato]::.. :: CATEGORY:[movies] 14:22:57 POSTPROCESS:: ######################################################### Traceback (most recent call last): File "/volume1/git/dev/nzbToMedia/nzbToCouchPotato.py", line 129, in nzbToMedia.main(sys.argv, section) File "/volume1/git/dev/nzbToMedia/nzbToMedia.py", line 424, in main results = process(dirName, os.path.basename(dirName), 0, clientAgent=clientAgent, inputCategory=category) File "/volume1/git/dev/nzbToMedia/nzbToMedia.py", line 294, in process result = autoProcessMovie().process(nzbDir, inputName, status, clientAgent, download_id, inputCategory) File "/volume1/git/dev/nzbToMedia/nzbtomedia/autoProcess/autoProcessMovie.py", line 153, in process releases = self.get_releases(baseURL, download_id, dirName, nzbName) File "/volume1/git/dev/nzbToMedia/nzbtomedia/autoProcess/autoProcessMovie.py", line 87, in get_releases id = release['_id'] KeyError: '_id'

[echel0n]

Ok new DEV release that should correct this issue and one other, please try and report back.

[Tjiet]

Im receiving the error: KeyError: 'media'

This is a manual spotweb download, no .cp(xxxxxxx) number.

Traceback (most recent call last): File "/Users/User/Documents/Sabnzbd/Scripts/nzbToCouchPotato.py", line 129, in result = nzbToMedia.main(sys.argv, section) File "/Users/User/Documents/Sabnzbd/Scripts/nzbToMedia.py", line 399, in main result = process(args[1], inputName=args[2], status=args[7], inputCategory=args[5], clientAgent=clientAgent, download_id='') File "/Users/User/Documents/Sabnzbd/Scripts/nzbToMedia.py", line 299, in process result = autoProcessMovie().process(nzbDir, inputName, status, clientAgent, download_id, inputCategory) File "/Users/User/Documents/Sabnzbd/Scripts/nzbtomedia/autoProcess/autoProcessMovie.py", line 128, in process release = self.get_release(baseURL, imdbid, download_id) File "/Users/User/Documents/Sabnzbd/Scripts/nzbtomedia/autoProcess/autoProcessMovie.py", line 45, in get_release movies = result[section] KeyError: 'media'

[echel0n]

I'll look into this now and see what is causing it, fairly sure I know exactly where this is happening.

[Tjiet]

I can tests if you like !

Op 21 apr. 2014 om 19:51 heeft echel0n notifications@github.com het volgende geschreven:

I'll look into this now and see what is causing it, fairly sure I know exactly where this is happening.

— Reply to this email directly or view it on GitHub.

[echel0n]

Perfect cause thats exactly what I'll need :)

[Tjiet]

Ok

Op 21 apr. 2014 om 19:53 heeft echel0n notifications@github.com het volgende geschreven:

Perfect cause thats exactly what I'll need :)

— Reply to this email directly or view it on GitHub.

[echel0n]

Question, was this movie even added to the wanted list in CP before running the scripts ?

[Tjiet]

no just a manual add from spotweb it was not on the wanted list

[echel0n]

Ok I can assure you that even if I fix this issue of the key error that it wouldn't add to the CP database anyways as its not in the wanted list and should be added before running manual runs to PP

[echel0n]

At the very least it needs to be in the wanted list is what I'm trying to say.

[Tjiet]

i know that is a cause for this problem, but before updating to the latest version all went extremely well with manually added movies, when it failed it mostly was the imdb id that CP could not find by query.

Maybe try to add it, if not, let couchgpotato handle the rest, because it will be picked up if the imdv is found...

[echel0n]

imdb is always found now so I just gotta track down where this issue is arising from, running prelim tests now

[Scoobdriver]

I can send my error log from calling torrenttomedia or letting transmission call it if it helps

— Sent from Mailbox for iPhone

On Mon, Apr 21, 2014 at 7:07 PM, Tjiet notifications@github.com wrote:

i know that is a cause for this problem, but before updating to the latest version all went extremely well with manually added movies, when it failed it mostly was the imdb id that CP could not find by query.

Maybe try to add it, if not, let couchgpotato handle the rest, because it will be picked up if the imdv is found...

Reply to this email directly or view it on GitHub: https://github.com/clinton-hall/nzbToMedia/issues/330#issuecomment-40959102

[Tjiet]

i can try with one that is on the wanted list. I'll download the same one ! manually

[echel0n]

yes please as your find this issue will be gone if on wanted list

[echel0n]

still it should exit gracefully and that Im attempting now

[Scoobdriver]

— Sent from Mailbox for iPhone

On Mon, Apr 21, 2014 at 7:10 PM, echel0n notifications@github.com wrote:

still it should exit gracefully and that Im attempting now

Reply to this email directly or view it on GitHub: https://github.com/clinton-hall/nzbToMedia/issues/330#issuecomment-40959422

[Scoobdriver]

[Tjiet]

it finished, but takes around 2,5 mins to run the script. With check for ffmpeg remove or disabled it should finish correctly i think

[20:12:45] [POSTPROCESS]::COUCHPOTATO: Starting renamer scan for The Movie (2013) BRRip XVID (720p) DD5_1 NL Subs.nzb [20:12:49] [POSTPROCESS]::COUCHPOTATO: SUCCESS: Finished renamer scan for folder /Users/User/Downloads/_Temp/Movies/The Movie (2013) BRRip XVID (720p) DD5_1 NL Subs [20:12:49] [POSTPROCESS]::COUCHPOTATO: Checking for status change, please stand by ... [20:13:09] [POSTPROCESS]::COUCHPOTATO: Checking for status change, please stand by ... [20:13:29] [POSTPROCESS]::COUCHPOTATO: Checking for status change, please stand by ... [20:13:50] [POSTPROCESS]::COUCHPOTATO: Checking for status change, please stand by ... [20:14:10] [POSTPROCESS]::COUCHPOTATO: Checking for status change, please stand by ... [20:14:30] [POSTPROCESS]::COUCHPOTATO: Checking for status change, please stand by ... [20:14:51] [WARNING]::COUCHPOTATO: The Movie (2013) BRRip XVID (720p) DD5_1 NL Subs.nzb does not appear to have changed status after 2 minutes, Please check your logs. [20:14:51] [ERROR]::MAIN: A problem was reported in the /Users/User/Documents/Sabnzbd/Scripts/nzbToCouchPotato.py script. yasm-1.2.0.tar.gz already downloaded [cmd]

[echel0n]

ok test new release and report back

[Tjiet]

In CP.log

[ couchpotato.api] Failed doing api request "media.get": Traceback (most recent call last): File "/var/CouchPotato/couchpotato/api.py", line 108, in run_handler res = apiroute File "/var/CouchPotato/couchpotato/core/media/_base/media/main.py", line 145, in getView media = self.get(id) if id else None File "/var/CouchPotato/couchpotato/core/media/_base/media/main.py", line 131, in get media = db.get('id', media_id) File "/var/CouchPotato/libs/CodernityDB/database.py", line 946, in get raise RecordDeleted("Deleted") RecordDeleted: Deleted

[echel0n]

Was it once in wanted list and then removed ?

[Tjiet]

[20:25:03] [INFO]::CLEANDIRS: Cleaning processing directories ... [20:25:03] [INFO]::MAIN: ######################################################### [20:25:03] [INFO]::MAIN: ## ..::[nzbToMedia.pyc]::.. ## [20:25:03] [INFO]::MAIN: ######################################################### [20:25:03] [INFO]::MAIN: Script triggered from SABnzbd [20:25:03] [INFO]::MAIN: Sending La Libertad (2001).nzb to COUCHPOTATO for post-processing ... [20:25:03] [ERROR]::TRANSCODER: Cannot detect corrupt video files!, set your ffmpeg_path in your autoProcessMedia.cfg ... [20:25:03] [INFO]::MAIN: Attemping imdbID lookup for La Libertad (2001).nzb [20:25:03] [INFO]::MAIN: Searching folder and file names for imdbID ... [20:25:03] [INFO]::MAIN: Searching IMDB for imdbID ... [20:25:03] [WARNING]::MAIN: Unable to find a imdbID for New Movie (2001).nzb [20:25:04] [POSTPROCESS]::COUCHPOTATO: Starting renamer scan for New Movie (2001).nzb [20:25:09] [POSTPROCESS]::COUCHPOTATO: SUCCESS: Finished renamer scan for folder /Users/User/Downloads/_Temp/Movies/New Movie (2001) [20:25:09] [POSTPROCESS]::COUCHPOTATO: Checking for status change, please stand by ... [20:25:10] [POSTPROCESS]::COUCHPOTATO: SUCCESS: Release New Movie (2001).nzb has now been marked with a status of [DONE] [20:25:10] [INFO]::CLEANDIRS: Cleaning processing directories ... [20:25:10] [INFO]::MAIN: The /Users/User/Documents/Sabnzbd/Scripts/nzbToCouchPotato.py script completed successfully. yasm-1.2.0.tar.gz already downloaded

[echel0n]

well that one looks good, new release will address issue with TorrentNoLink option as well

[Tjiet]

No first one is one in the list, maybe because the file already existed ? same quality or something like that ?

Second run was a release not in CP wanted...

[Tjiet]

let me try with the first release again, it is not in CP wanted any more..

[echel0n]

sounds good

[Tjiet]

[20:31:44] [INFO]::CLEANDIRS: Cleaning processing directories ... [20:31:44] [INFO]::MAIN: ######################################################### [20:31:44] [INFO]::MAIN: ## ..::[nzbToMedia.pyc]::.. ## [20:31:44] [INFO]::MAIN: ######################################################### [20:31:44] [INFO]::MAIN: Script triggered from SABnzbd [20:31:44] [INFO]::MAIN: Sending The Physician (2013) BRRip XVID (720p) DD5_1 NL Subs.nzb to COUCHPOTATO for post-processing ... [20:31:44] [ERROR]::TRANSCODER: Cannot detect corrupt video files!, set your ffmpeg_path in your autoProcessMedia.cfg ... [20:31:44] [INFO]::MAIN: Attemping imdbID lookup for The Physician (2013) BRRip XVID (720p) DD5_1 NL Subs.nzb [20:31:44] [INFO]::MAIN: Searching folder and file names for imdbID ... [20:31:44] [INFO]::MAIN: Searching IMDB for imdbID ... [20:31:44] [INFO]::MAIN: Found imdbID [tt2101473] [20:31:45] [ERROR]::MAIN: Failed returning results [20:31:45] [ERROR]::COUCHPOTATO: Unable to find The Physician (2013) BRRip XVID (720p) DD5_1 NL Subs.nzb in your wanted list, skipping ... [20:31:45] [ERROR]::MAIN: A problem was reported in the /Users/User/Documents/Sabnzbd/Scripts/nzbToCouchPotato.py script. yasm-1.2.0.tar.gz already downloaded

[Tjiet]

CP LOG:

[ couchpotato.api] Failed doing api request "media.get": Traceback (most recent call last): File "/var/CouchPotato/couchpotato/api.py", line 108, in run_handler res = apiroute File "/var/CouchPotato/couchpotato/core/media/_base/media/main.py", line 145, in getView media = self.get(id) if id else None File "/var/CouchPotato/couchpotato/core/media/_base/media/main.py", line 129, in get media = db.get('media', 'imdb-%s' % imdb_id, with_doc = True)['doc'] File "/var/CouchPotato/libs/CodernityDB/database.py", line 942, in get raise RecordNotFound(ex) RecordNotFound

[echel0n]

Perfect! nzbToMedia gracefully exited without key errors