[QUESTION]Try to get the time of the video clip uploaded to the server

wangziheng437 commented 3 years ago

Try to get the time of the video clip uploaded to the server

I used the v1.0 version before. By registering a callback to fragmentAckReceivedFn, I can receive the callback twice when every 2s of video clips successfully uploaded. But when I update to version 3.0 & 3.1, this callback looks out of time. Here are some logs(Please note that "send ok" is the upper code triggered by the callback, the interval between two callbacks is 4s):

Logging [2021-02-05 19:35:13] 5bf3cd1cfc3fb0829ebac9aeffc8127747b t.us-west-2.amazonaws.com t;>>>0<<<<<<<<<<<<<< Initializing native heap with limit size 9437184, spill ratio 0% and flags 0x00000001 Creating AIV heap. Heap is initialized OK State Machine - Current state: 0x0000000000000001, Next state: 0x0000000000000002 State Machine - Current state: 0x0000000000000002, Next state: 0x0000000000000010 Create device result event. State Machine - Current state: 0x0000000000000010, Next state: 0x0000000000000040 Creating Kinesis Video Stream. Kinesis Video Stream Info Stream name: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b Streaming type: STREAMING_TYPE_REALTIME Content type: video/h264,audio/alaw Max latency (100ns): 510000000 Fragment duration (100ns): 20000000 Key frame fragmentation: Yes Use frame timecode: Yes Absolute frame timecode: Yes Nal adaptation flags: 40 Average bandwith (bps): 2097152 Framerate: 130 Buffer duration (100ns): 600000000 Replay duration (100ns): 300000000 Connection Staleness duration (100ns): 50000000 Store Pressure Policy: 1 View Overflow Policy: 1 Segment UUID: NULL Frame ordering mode: 3 Track list Track id: 1 Track name: kvs_video_track Codec id: V_MPEG4/ISO/AVC Track type: TRACK_INFO_TYPE_VIDEO Track cpd: NULL Track id: 2 Track name: kvs_audio_track Codec id: A_MS/ACM Track type: TRACK_INFO_TYPE_AUDIO Track cpd: 06000100401F0000803E0000020010000000 State Machine - Current state: 0x0000000000000001, Next state: 0x0000000000000002 Kinesis Video client and stream metrics: Overall storage byte size: 9437184 Available storage byte size: 9383310 Allocated storage byte size: 53874 Total view allocation byte size: 374480 Total streams frame rate (fps): 130 Total streams transfer rate (bps): 16777216 (16384 Kbps) Current view duration (ms): 0 Overall view duration (ms): 0 Current view byte size: 0 Overall view byte size: 0 Current frame rate (fps): 130.000000 Current transfer rate (bps): 16777216 (16384 Kbps) Stream uptime in (ms): 82 Total transferred bytes: 0 Total number of streaming sessions: 0 Total number of active streaming sessions: 0 Average streaming sessions duration: 0 Number of Buffered ACKs: 0 Number of Received ACKs: 0 Number of Persisted ACKs: 0 Number of Error ACKs: 0 Number of dropped frames: 0 Number of skipped frames: 0 Number of storage pressure events: 0 Number of latency pressure events: 0 Number of buffer pressure events: 0 Number of stream staleness events: 0 Number of latency pressure events: 0 Number of Put Frame errors: 0 Average Control Plane API latency (ms): 0 Average Data Plane API latency (ms): 0 Kinesis Video client and stream metrics: Overall storage byte size: 9437184 Available storage byte size: 9027434 Allocated storage byte size: 409750 Total view allocation byte size: 374480 Total streams frame rate (fps): 4109 Total streams transfer rate (bps): 16777216 (16384 Kbps) Current view duration (ms): 2015 Overall view duration (ms): 2015 Current view byte size: 332757 Overall view byte size: 332757 Current frame rate (fps): 4109.863869 Current transfer rate (bps): 16777216 (16384 Kbps) Stream uptime in (ms): 582 Total transferred bytes: 0 Total number of streaming sessions: 0 Total number of active streaming sessions: 0 Average streaming sessions duration: 0 Number of Buffered ACKs: 0 Number of Received ACKs: 0 Number of Persisted ACKs: 0 Number of Error ACKs: 0 Number of dropped frames: 0 Number of skipped frames: 0 Number of storage pressure events: 0 Number of latency pressure events: 0 Number of buffer pressure events: 0 Number of stream staleness events: 0 Number of latency pressure events: 0 Number of Put Frame errors: 0 Average Control Plane API latency (ms): 0 Average Data Plane API latency (ms): 0 Kinesis Video client and stream metrics: Overall storage byte size: 9437184 Available storage byte size: 8932896 Allocated storage byte size: 504288 Total view allocation byte size: 374480 Total streams frame rate (fps): 6378 Total streams transfer rate (bps): 16777216 (16384 Kbps) Current view duration (ms): 4015 Overall view duration (ms): 4015 Current view byte size: 473235 Overall view byte size: 473235 Current frame rate (fps): 6378.968281 Current transfer rate (bps): 16777216 (16384 Kbps) Stream uptime in (ms): 1156 Total transferred bytes: 0 Total number of streaming sessions: 0 Total number of active streaming sessions: 0 Average streaming sessions duration: 0 Number of Buffered ACKs: 0 Number of Received ACKs: 0 Number of Persisted ACKs: 0 Number of Error ACKs: 0 Number of dropped frames: 0 Number of skipped frames: 0 Number of storage pressure events: 0 Number of latency pressure events: 0 Number of buffer pressure events: 0 Number of stream staleness events: 0 Number of latency pressure events: 0 Number of Put Frame errors: 0 Average Control Plane API latency (ms): 0 Average Data Plane API latency (ms): 0 RequestId: 62f6d7ad-0f92-49f0-bca2-7223fd1b15c1 DescribeStream API response: {"StreamInfo":{"CreationTime":1.603954712212E9,"DataRetentionInHours":336,"DeviceName":null,"IngestionConfiguration":null,"KmsKeyId":"arn:aws:kms:us-west-2:066587586721:alias/aws/kinesisvideo","MediaType":null} Describe stream result event. Retention period returned from the DescribeStream call doesn't match the one specified in the StreamInfo Content type returned from the DescribeStream call doesn't match the one specified in the StreamInfo State Machine - Current state: 0x0000000000000002, Next state: 0x0000000000000020 Kinesis Video client and stream metrics: Overall storage byte size: 9437184 Available storage byte size: 8842471 Allocated storage byte size: 594713 Total view allocation byte size: 374480 Total streams frame rate (fps): 5380 Total streams transfer rate (bps): 16777216 (16384 Kbps) Current view duration (ms): 6015 Overall view duration (ms): 6015 Current view byte size: 557828 Overall view byte size: 557828 Current frame rate (fps): 5380.407884 Current transfer rate (bps): 16777216 (16384 Kbps) Stream uptime in (ms): 2052 Total transferred bytes: 0 Total number of streaming sessions: 0 Total number of active streaming sessions: 0 Average streaming sessions duration: 0 Number of Buffered ACKs: 0 Number of Received ACKs: 0 Number of Persisted ACKs: 0 Number of Error ACKs: 0 Number of dropped frames: 0 Number of skipped frames: 0 Number of storage pressure events: 0 Number of latency pressure events: 0 Number of buffer pressure events: 0 Number of stream staleness events: 0 Number of latency pressure events: 0 Number of Put Frame errors: 0 Average Control Plane API latency (ms): 67 Average Data Plane API latency (ms): 0 RequestId: 7d9f6f93-bab1-4a4a-9ca7-17ba542f1029 ntCurlHandler(): GetStreamingEndpoint API response: {"DataEndpoint":"https://s-b1731d75.kinesisvideo.us-west-2.amazonaws.com"} ntResultEvent(): Get streaming endpoint result event. State Machine - Current state: 0x0000000000000020, Next state: 0x0000000000000010 Get streaming token result event. State Machine - Current state: 0x0000000000000010, Next state: 0x0000000000000040 State Machine - Current state: 0x0000000000000040, Next state: 0x0000000000000080 Put stream result event. New upload handle 0 State Machine - Current state: 0x0000000000000080, Next state: 0x0000000000000100 Kinesis Video client and stream metrics: Overall storage byte size: 9437184 Available storage byte size: 8744536 Allocated storage byte size: 692648 Total view allocation byte size: 374480 Total streams frame rate (fps): 1899 Total streams transfer rate (bps): 16777216 (16384 Kbps) Current view duration (ms): 8000 Overall view duration (ms): 8000 Current view byte size: 655960 Overall view byte size: 655960 Current frame rate (fps): 1899.142316 Current transfer rate (bps): 16777216 (16384 Kbps) Stream uptime in (ms): 3898 Total transferred bytes: 0 Total number of streaming sessions: 1 Total number of active streaming sessions: 0 Average streaming sessions duration: 0 Number of Buffered ACKs: 0 Number of Received ACKs: 0 Number of Persisted ACKs: 0 Number of Error ACKs: 0 Number of dropped frames: 0 Number of skipped frames: 0 Number of storage pressure events: 0 Number of latency pressure events: 0 Number of buffer pressure events: 0 Number of stream staleness events: 0 Number of latency pressure events: 0 Number of Put Frame errors: 0 Average Control Plane API latency (ms): 128 Average Data Plane API latency (ms): 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 RequestId: e9fbddda-49ca-a453-b16c-f26d7d9b4fcb Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 0 returned: {"EventType":"BUFFERING","FragmentTimecode":1612524909086,"FragmentNumber":"91343852333181575993} Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Kinesis Video client and stream metrics: Overall storage byte size: 9437184 Available storage byte size: 8617626 Allocated storage byte size: 819558 Total view allocation byte size: 374480 Total streams frame rate (fps): 1507 Total streams transfer rate (bps): 11560600 (11289 Kbps) Current view duration (ms): 8000 Overall view duration (ms): 10015 Current view byte size: 457835 Overall view byte size: 789734 Current frame rate (fps): 1507.377375 Current transfer rate (bps): 11560600 (11289 Kbps) Stream uptime in (ms): 5906 Total transferred bytes: 327440 Total number of streaming sessions: 1 Total number of active streaming sessions: 1 Average streaming sessions duration: 0 Number of Buffered ACKs: 1 Number of Received ACKs: 0 Number of Persisted ACKs: 0 Number of Error ACKs: 0 Number of dropped frames: 0 Number of skipped frames: 0 Number of storage pressure events: 0 Number of latency pressure events: 0 Number of buffer pressure events: 0 Number of stream staleness events: 0 Number of latency pressure events: 0 Number of Put Frame errors: 0 Average Control Plane API latency (ms): 128 Average Data Plane API latency (ms): 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 0 returned: {"EventType":"RECEIVED","FragmentTimecode":1612524909086,"FragmentNumber":"913438523331815759937} Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 0 returned: {"EventType":"BUFFERING","FragmentTimecode":1612524911136,"FragmentNumber":"91343852333181575998} Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 0 returned: {"EventType":"PERSISTED","FragmentTimecode":1612524909086,"FragmentNumber":"91343852333181575993} ok------------------1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 teMachineHandleConnectionStale(): Connection Stale State Machine starting from NORMAL_STATE teMachineSetResetConnectionState(): Connection Stale State Machine move to RESET_CONNECTION_STATE State Machine - Current state: 0x0000000000000100, Next state: 0x0000000000000200 State Machine - Current state: 0x0000000000000200, Next state: 0x0000000000000020 ntResultEvent(): Get streaming endpoint result event. State Machine - Current state: 0x0000000000000020, Next state: 0x0000000000000010 Get streaming token result event. State Machine - Current state: 0x0000000000000010, Next state: 0x0000000000000040 State Machine - Current state: 0x0000000000000040, Next state: 0x0000000000000080 Put stream result event. New upload handle 1 State Machine - Current state: 0x0000000000000080, Next state: 0x0000000000000100 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 0 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 0 returned: {"EventType":"RECEIVED","FragmentTimecode":1612524911136,"FragmentNumber":"913438523331815759986} An ACK is received for an already expired upload handle 0 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 0 returned: {"EventType":"BUFFERING","FragmentTimecode":1612524913136,"FragmentNumber":"91343852333181576003} An ACK is received for an already expired upload handle 0 Reported abort-connection for Upload handle: 0 HTTP Error 408 : Response: (null) Network thread for Kinesis Video stream: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b with upload handle: 0 exited. http status: 408 Kinesis Video client and stream metrics: Overall storage byte size: 9437184 Available storage byte size: 8818830 Allocated storage byte size: 618354 Total view allocation byte size: 374480 Total streams frame rate (fps): 1335 Total streams transfer rate (bps): 10318080 (10076 Kbps) Current view duration (ms): 9965 Overall view duration (ms): 9965 Current view byte size: 578759 Overall view byte size: 578759 Current frame rate (fps): 1335.379152 Current transfer rate (bps): 10318080 (10076 Kbps) Stream uptime in (ms): 7947 Total transferred bytes: 638508 Total number of streaming sessions: 2 Total number of active streaming sessions: 1 Average streaming sessions duration: 2072800 Number of Buffered ACKs: 2 Number of Received ACKs: 1 Number of Persisted ACKs: 1 Number of Error ACKs: 0 Number of dropped frames: 0 Number of skipped frames: 0 Number of storage pressure events: 0 Number of latency pressure events: 0 Number of buffer pressure events: 0 Number of stream staleness events: 1 Number of latency pressure events: 0 Number of Put Frame errors: 0 Average Control Plane API latency (ms): 122 Average Data Plane API latency (ms): 0 RequestId: ee73204d-19c4-d355-b6e4-0ff66444a8ac Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 1 returned: {"EventType":"BUFFERING","FragmentTimecode":1612524911136,"FragmentNumber":"91343852333181580945} Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Kinesis Video client and stream metrics: Overall storage byte size: 9437184 Available storage byte size: 8680122 Allocated storage byte size: 757062 Total view allocation byte size: 374480 Total streams frame rate (fps): 1049 Total streams transfer rate (bps): 7724360 (7543 Kbps) Current view duration (ms): 9915 Overall view duration (ms): 11965 Current view byte size: 535324 Overall view byte size: 700975 Current frame rate (fps): 1049.195340 Current transfer rate (bps): 7724360 (7543 Kbps) Stream uptime in (ms): 9988 Total transferred bytes: 785856 Total number of streaming sessions: 2 Total number of active streaming sessions: 2 Average streaming sessions duration: 2072800 Number of Buffered ACKs: 3 Number of Received ACKs: 1 Number of Persisted ACKs: 1 Number of Error ACKs: 0 Number of dropped frames: 0 Number of skipped frames: 0 Number of storage pressure events: 0 Number of latency pressure events: 0 Number of buffer pressure events: 0 Number of stream staleness events: 1 Number of latency pressure events: 0 Number of Put Frame errors: 0 Average Control Plane API latency (ms): 122 Average Data Plane API latency (ms): 0 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 1 returned: {"EventType":"RECEIVED","FragmentTimecode":1612524911136,"FragmentNumber":"913438523331815809454} Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 1 returned: {"EventType":"BUFFERING","FragmentTimecode":1612524913136,"FragmentNumber":"91343852333181580950} Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Wrote 16372 bytes to Kinesis Video. Upload stream handle: 1 Curl post body write function for stream with handle: 9ca012f850d35bcd983c58a949a505bf3cd1cfc3fb0829ebac9aeffc8127747b and upload handle: 1 returned: {"EventType":"PERSISTED","FragmentTimecode":1612524911136,"FragmentNumber":"91343852333181580945} ok------------------2

MushMal commented 3 years ago

Information on the ACKs is available here: https://github.com/awslabs/amazon-kinesis-video-streams-producer-sdk-cpp/blob/master/docs/structures.md#fragment-acks

There are multiple types of ACKs and they are sent at certain events so you can check the type of ACK you are getting. Basically, the buffering ACK is sent as soon as the new fragment is started getting parsed. The received ACK is sent as soon as the fragment is "closed" and the persistence and indexing has just started. The persisted ACK is sent after the fragment has been persisted. It takes certain period of time for the persistence and due to highly asynchronous nature of the operations, there is no immediate guarantee that it will be performed in real-time.

Looking at your log I can see the following entry:

2021-02-05 19:35:22] 2021-02-05 11:35:20 WARN streamFragmentAckEvent(): An ACK is received for an already expired upload handle 0 This happens after you get an ACK on a connection that was deemed to be stale so the continuous retry callback has re-set the connection. From your log I can see

[2021-02-05 19:35:15] 2021-02-05 11:35:14 DEBUG logStreamInfo(): Connection Staleness duration (100ns): 50000000

This means that you are going to get your connection reset after 5 seconds of not getting any feedback from the service. This might be too aggressive in your network case as you will get your connection reset every time there is a perceived staleness event. Try changing it to a larger value.

hassanctech commented 3 years ago

Closing because this question has been answered. If you still need help please re-open, or if you have a new question please open a new issue.

awslabs / amazon-kinesis-video-streams-producer-sdk-cpp

[QUESTION]Try to get the time of the video clip uploaded to the server #653