Only downloads first hour of three-hour program

[musicals68]

Tried both 3.5.3 and 3.4.6 on Macbook Pro running OS 10.14.6 There's a recording that the TiVo Roamio box says is 3:31 long, and it is--I've watched all of it. cTivo also reports it is that long, but the download completes "successfully" having dowloaded only 1:00:30. With debugging set to verbose, there are no errors in the .txt file Any idea what's going wrong, or what changes to parameters might fix it?

[mackworth]

Can you post the log file? (Help>show logs in finder>cmd-click>compress and then post here.

[mackworth]

I can take a look, but TBH, even though I haven’t seen this symptom before, there’s not much hope. Although TiVo provides us with the various metadata (such as time and size), all we can ultimately request is the file associated with the URL. If the TiVo only delivers a portion of the show, then that’s what we get. There’s no support for a partial file, or restarting in the middle, etc.

One possible fix: If you have another TiVo, you could try transferring this show to it, and then download from there.

[musicals68]

On Aug 6, 2023, at 1:49 PM, Hugh Mackworth @.**@.>> wrote:

I can take a look, but TBH, even though I haven’t seen this symptom before, there’s not much hope. Although TiVo provides us with the various metadata (such as time and size), all we can ultimately request is the file associated with the URL. If the TiVo only delivers a portion of the show, then that’s what we get. There’s no support for a partial file, or restarting in the middle, etc.

One possible fix: If you have another TiVo, you could try transferring this show to it, and then download from there.

Already tried that, actually. It did transfer the full length, but cTivo truncates at exactly the same point. I'm just wondering if there's any chance there some stray code in the program signal at that point that cTivo (mis)interprets as EndOfFile, in which case a different decoder or turning off some error checking function might help? (I say this as an old CompSci major with zero knowledge of how TiVos work, so forgive me if it's horribly naive.)

Thank you for the rapid response!

FWIW here's the .txt file

showingBits : 4099 time : 2015-06-08T03:00:00Z showingBits : 0 colorCode : 4 description : At Radio City Music Hall in New York, the annual ceremony honors excellence on Broadway; scheduled performers include Christian Borle, Tyne Daly, Kelsey Grammer, Vanessa Hudgens and Brian d'Arcy James; Kristin Chenoweth and Alan Cumming host. vDirector : Weiss|Glenn vExecProducer : Kirshner|Ricky vExecProducer : Weiss|Glenn vHost : Chenoweth|Kristin vHost : Cumming|Alan isEpisode : true originalAirDate : 2015-06-07T00:00:00Z seriesTitle : The 69th Annual Tony Awards title : The 69th Annual Tony Awards startTime : 2023-07-29T01:16:23Z stopTime : 2023-07-29T02:01:11Z seriesId : SH0323835616 displayMajorNumber : 1209 callsign : KCBSDT programId : SH0323835616-0323835162

[musicals68]

On Aug 6, 2023, at 12:40 PM, Hugh Mackworth @.**@.>> wrote:

Can you post the log file? (Help>show logs in finder>cmd-click>compress and then post here.

— Reply to this email directly, view it on GitHubhttps://github.com/mackworth/cTiVo/issues/522#issuecomment-1666952157, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BBX7CKA6RAIE7I44TOUPQ4DXT7XKXANCNFSM6AAAAAA3FZYTGA. You are receiving this because you authored the thread.Message ID: @.***>

[mackworth]

Unfortunately, GitHub deletes attachments when you reply by email. You have to come back to the website issues page in order to attach.

[musicals68]

Sorry, didn't know. com.cTiVo.cTiVo 2023-08-06--07-29-42-649.log.zip

[mackworth]

(No problem; it's definitely an annoying choice on their part.)

That doesn't show the end of the transmission. Is there a later log? (Last time in this file is 2023-08-06 07:41:26:185 )

[musicals68]

Uh, there's this, much later tiny one...wasn't sure it was related.

com.cTiVo.cTiVo 2023-08-06--23-17-33-472.log

[musicals68]

And here's the .txt file FWIW The 69th Annual Tony Awards.mp4.txt

[musicals68]

And here's the log from another attempt after the software update. com.cTiVo.cTiVo 2023-08-10--11-51-26-348.log.zip

[mackworth]

Sorry, although that log is more complete, it's pretty clear that what I presumed is indeed the case: TiVo tells us there's an 18GB file, but when we request it, it's only delivering 5GB of it. You'll see at the end that cTiVo is itself "surprised" by this.

For historic reasons, TiVo internally keeps two sets of metadata about a show, which we get through an URL vs RPC. Sometimes in the GUI, you'll see different season/episode info on two screens. My guess is that one of those guide data was mis-set to an hour, and so that's what it's delivering on the download.

There's no way to request more data or restart in the middle, so really nothing I can do.

The relevant clips

2023-08-10 04:56:07:717 -[MTDownload launchDownload]@1685>Starting download (type 2) for The 69th Annual Tony Awards-Roamio(b1a70); Format: Test PS; simul encode; Keep after iTunes;tivodecode-ng; Program Stream
2023-08-10 04:56:07:763 -[MTDownload observeValueForKeyPath:ofObject:change:context:]@263>Changing DL status of The 69th Annual Tony Awards-Roamio(b1a70) to Downloading (2)
2023-08-10 04:56:07:763 -[MTDownload launchDownload]@1906>Starting URL http://dvr-39db.local.:80/download/The%2069th%20Annual%20Tony%20Awards.TiVo?Container=%2FNowPlaying&id=226644 for show The 69th Annual Tony Awards-Roamio(b1a70) in 0.0 seconds
2023-08-10 04:56:08:830 -[MTDownload connection:didReceiveResponse:]@2794>Response Headers: {    "TiVo-Estimated-Length" = 18706595840; }
...
2023-08-10 05:07:50:526 -[MTDownload connectionDidFinishLoading:]@2905>Download URL Connection finished for The 69th Annual Tony Awards-Roamio(83a70)
2023-08-10 05:07:50:526 -[MTDownload connectionDidFinishLoading:]@2916>writing last data for The 69th Annual Tony Awards-Roamio(83a70)
2023-08-10 05:07:50:526 -[MTDownload connectionDidFinishLoading:]@2965>finished loading TiVo file: 5145147.3 of 18706595.8 KB expected; 27.5% 
...
2023-08-10 05:28:56:514 -[MTTask trackProcess]@322>New progress value for encode is 100.0%
2023-08-10 05:28:56:749 -[MTTask launch]_block_invoke_2@476>encode task terminated. Status: 0
2023-08-10 05:28:56:749 -[MTTask completeProcess]@223>Finished task encode of show The 69th Annual Tony Awards with completion code 0 and reason exit
2023-08-10 05:28:56:749 -[MTDownload observeValueForKeyPath:ofObject:change:context:]@263>Changing DL status of The 69th Annual Tony Awards-Roamio(83a70) to Encoded (12)
2023-08-10 05:28:56:750 -[MTDownloadTableView tableView:viewForTableColumn:row:]@389>Icon: save-until-i-delete-recording for The 69th Annual Tony Awards
2023-08-10 05:28:56:750 -[MTDownload cancelPerformanceTimer]@311>cancelling performance timer
2023-08-10 05:28:56:750 -[MTDownload observeValueForKeyPath:ofObject:change:context:]@281>The 69th Annual Tony Awards-Roamio(83a70) at 100.0%
2023-08-10 05:28:56:751 -[MTDownload encodeTask]_block_invoke_2@1241>Show The 69th Annual Tony Awards (Roamio) 0x7fd5e8dd9680 supposed to be 18706596 Kbytes, actually 5145147 Kbytes (27.5%)
2023-08-10 05:28:56:751 -[MTTiVoManager notifyForName:withTitle:subTitle:isSticky:]@1747>Notify: The 69th Annual Tony Awards: Warning: Show may be damaged/incomplete.

[musicals68]

OK, thank you for looking into it!

On Aug 11, 2023, at 4:23 PM, Hugh Mackworth @.**@.>> wrote:

Sorry, although that log is more complete, it's pretty clear that what I presumed is indeed the case: TiVo tells us there's an 18GB file, but when we request it, it's only delivering 5GB of it. You'll see at the end that cTiVo is itself "surprised" by this.

For historic reasons, TiVo internally keeps two sets of metadata about a show, which we get through an URL vs RPC. Sometimes in the GUI, you'll see different season/episode info on two screens. My guess is that one of those guide data was mis-set to an hour, and so that's what it's delivering on the download.

There's no way to request more data or restart in the middle, so really nothing I can do.

The relevant clips

2023-08-10 04:56:07:717 -[MTDownload @.>Starting download (type 2) for The 69th Annual Tony Awards-Roamio(b1a70); Format: Test PS; simul encode; Keep after iTunes;tivodecode-ng; Program Stream 2023-08-10 04:56:07:763 -[MTDownload @.>Changing DL status of The 69th Annual Tony Awards-Roamio(b1a70) to Downloading (2) 2023-08-10 04:56:07:763 -[MTDownload @.>Starting URL http://dvr-39db.local.:80/download/The%2069th%20Annual%20Tony%20Awards.TiVo?Container=%2FNowPlaying&id=226644 for show The 69th Annual Tony Awards-Roamio(b1a70) in 0.0 seconds 2023-08-10 04:56:08:830 -[MTDownload @.>Response Headers: { "TiVo-Estimated-Length" = 18706595840; } ... 2023-08-10 05:07:50:526 -[MTDownload @.>Download URL Connection finished for The 69th Annual Tony Awards-Roamio(83a70) 2023-08-10 05:07:50:526 -[MTDownload @.>writing last data for The 69th Annual Tony Awards-Roamio(83a70) 2023-08-10 05:07:50:526 -[MTDownload @.>finished loading TiVo file: 5145147.3 of 18706595.8 KB expected; 27.5% ... 2023-08-10 05:28:56:514 -[MTTask @.>New progress value for encode is 100.0% 2023-08-10 05:28:56:749 -[MTTask @.>encode task terminated. Status: 0 2023-08-10 05:28:56:749 -[MTTask @.>Finished task encode of show The 69th Annual Tony Awards with completion code 0 and reason exit 2023-08-10 05:28:56:749 -[MTDownload @.>Changing DL status of The 69th Annual Tony Awards-Roamio(83a70) to Encoded (12) 2023-08-10 05:28:56:750 -[MTDownloadTableView @.>Icon: save-until-i-delete-recording for The 69th Annual Tony Awards 2023-08-10 05:28:56:750 -[MTDownload @.>cancelling performance timer 2023-08-10 05:28:56:750 -[MTDownload @.>The 69th Annual Tony Awards-Roamio(83a70) at 100.0% 2023-08-10 05:28:56:751 -[MTDownload @.>Show The 69th Annual Tony Awards (Roamio) 0x7fd5e8dd9680 supposed to be 18706596 Kbytes, actually 5145147 Kbytes (27.5%) 2023-08-10 05:28:56:751 -[MTTiVoManager @.>Notify: The 69th Annual Tony Awards: Warning: Show may be damaged/incomplete.

— Reply to this email directly, view it on GitHubhttps://github.com/mackworth/cTiVo/issues/522#issuecomment-1675512177, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BBX7CKCZBV62NKQDTVILRR3XU25ILANCNFSM6AAAAAA3FZYTGA. You are receiving this because you authored the thread.Message ID: @.***>

[mackworth]

You're welcome. Let me know if you have any other issues.