harlanc / xiu

A simple,high performance and secure live media server in pure Rust (RTMP[cluster]/RTSP/WebRTC[whip/whep]/HTTP-FLV/HLS).🦀
https://rustxiu.com
MIT License
1.77k stars 187 forks source link

thread 'tokio-runtime-worker' panicked at 'attempt to add with overflow' #25

Closed rutmir closed 10 months ago

rutmir commented 1 year ago

When I try to send video stream from external device (mavic DJI mini 2) I get error: thread 'tokio-runtime-worker' panicked at 'attempt to add with overflow', /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/rtmp-0.0.14/src/chunk/unpacketizer.rs:421:21 stack backtrace: 0: 0x555555809a7d - std::backtrace_rs::backtrace::libunwind::trace::h9135f25bc195152c at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/../../backtrace/src/backtrace/libunwind.rs:93:5 1: 0x555555809a7d - std::backtrace_rs::backtrace::trace_unsynchronized::h015ee85be510df51 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/../../backtrace/src/backtrace/mod.rs:66:5 2: 0x555555809a7d - std::sys_common::backtrace::_print_fmt::h5fad03caa9652a2c at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/sys_common/backtrace.rs:66:5 3: 0x555555809a7d - ::fmt::h2b42ca28d244e5c7 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/sys_common/backtrace.rs:45:22 4: 0x55555582925c - core::fmt::write::h401e827d053130ed at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/fmt/mod.rs:1198:17 5: 0x5555558051a1 - std::io::Write::write_fmt::hffec93268f5cde32 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/io/mod.rs:1672:15 6: 0x55555580b245 - std::sys_common::backtrace::_print::h180c4c706ee1d3fb at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/sys_common/backtrace.rs:48:5 7: 0x55555580b245 - std::sys_common::backtrace::print::hd0c35d18765761c9 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/sys_common/backtrace.rs:35:9 8: 0x55555580b245 - std::panicking::default_hook::{{closure}}::h1f023310983bc730 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:295:22 9: 0x55555580af61 - std::panicking::default_hook::h188fec3334afd5be at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:314:9 10: 0x55555580b7d6 - std::panicking::rust_panic_with_hook::hf26e9d4f97b40096 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:698:17 11: 0x55555580b689 - std::panicking::begin_panic_handler::{{closure}}::hfab912107608087a at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:586:13 12: 0x555555809f74 - std::sys_common::backtrace::rust_end_short_backtrace::h434b685ce8d9965b at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/sys_common/backtrace.rs:138:18 13: 0x55555580b3f9 - rust_begin_unwind at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:584:5 14: 0x55555559c593 - core::panicking::panic_fmt::ha6dc7f2ab2479463 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/panicking.rs:142:14 15: 0x55555559c45d - core::panicking::panic::hb3ad04c589a0e3c8 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/panicking.rs:48:5 16: 0x555555631404 - rtmp::chunk::unpacketizer::ChunkUnpacketizer::read_extended_timestamp::h879dce656afd8562 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/rtmp-0.0.14/src/chunk/unpacketizer.rs:421:21 17: 0x55555562f1fb - rtmp::chunk::unpacketizer::ChunkUnpacketizer::read_chunk::h37a9c9badbc91186 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/rtmp-0.0.14/src/chunk/unpacketizer.rs:154:58 18: 0x55555562e7c5 - rtmp::chunk::unpacketizer::ChunkUnpacketizer::read_chunks::hbb8a8128ebaa4863 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/rtmp-0.0.14/src/chunk/unpacketizer.rs:98:19 19: 0x5555555a5728 - rtmp::session::server_session::ServerSession::read_parse_chunks::{{closure}}::ha64c8515bc5d3e8a at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/rtmp-0.0.14/src/session/server_session.rs:165:26 20: 0x5555555d3e31 - <core::future::from_generator::GenFuture as core::future::future::Future>::poll::h950141e973fb3aee at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/future/mod.rs:91:19 21: 0x5555555a8428 - rtmp::session::server_session::ServerSession::run::{{closure}}::h23095bb195456cee at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/rtmp-0.0.14/src/session/server_session.rs:95:45 22: 0x5555555d41f1 - <core::future::from_generator::GenFuture as core::future::future::Future>::poll::ha83efaae53ccce2d at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/future/mod.rs:91:19 23: 0x5555555b741a - rtmp::rtmp::RtmpServer::run::{{closure}}::{{closure}}::ha4e4ea9f263e3224 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/rtmp-0.0.14/src/rtmp.rs:33:48 24: 0x5555555d54bb - <core::future::from_generator::GenFuture as core::future::future::Future>::poll::hef19bebd94a61812 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/future/mod.rs:91:19 25: 0x5555555d9fff - <core::pin::Pin

as core::future::future::Future>::poll::h4f4935b2159bf39d at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/future/future.rs:124:9 26: 0x55555561c5bf - tokio::runtime::task::core::CoreStage::poll::{{closure}}::he10b6d0134dbfa38 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/core.rs:184:17 27: 0x55555560f790 - tokio::loom::std::unsafe_cell::UnsafeCell::with_mut::h9c1842a770393d02 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/loom/std/unsafe_cell.rs:14:9 28: 0x55555561c217 - tokio::runtime::task::core::CoreStage::poll::hd4c60b6b25461345 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/core.rs:174:13 29: 0x5555555e4b84 - tokio::runtime::task::harness::poll_future::{{closure}}::h2fa09fe527077857 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/harness.rs:480:19 30: 0x5555555bb0f3 - <core::panic::unwind_safe::AssertUnwindSafe as core::ops::function::FnOnce<()>>::call_once::h7a4835f3986a91aa at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/panic/unwind_safe.rs:271:9 31: 0x5555555c33d0 - std::panicking::try::do_call::he86e6d1a05044b05 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:492:40 32: 0x5555555c638b - rust_try 33: 0x5555555c1546 - std::panicking::try::hcb6081aedc2f06a3 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:456:19 34: 0x5555556057ba - std::panic::catch_unwind::h1b3eb9fed873e8db at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panic.rs:137:14 35: 0x5555555e25cd - tokio::runtime::task::harness::poll_future::h26071615758edbdf at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/harness.rs:468:18 36: 0x5555555e6fc6 - tokio::runtime::task::harness::Harness<T,S>::poll_inner::h56e62f3e9b3e75fa at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/harness.rs:104:27 37: 0x5555555eda53 - tokio::runtime::task::harness::Harness<T,S>::poll::hed4c37b9836dbdce at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/harness.rs:57:15 38: 0x5555555cd340 - tokio::runtime::task::raw::poll::h84fcf8eb9b926d56 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/raw.rs:194:5 39: 0x5555556e034f - tokio::runtime::task::raw::RawTask::poll::h2f99aff06af6e3a7 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/raw.rs:134:18 40: 0x5555556d0242 - tokio::runtime::task::LocalNotified::run::hf58dcd95a296aafa at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/mod.rs:385:9 41: 0x55555571793c - tokio::runtime::scheduler::multi_thread::worker::Context::run_task::{{closure}}::he2a7b0ee8da8f342 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/scheduler/multi_thread/worker.rs:421:13 42: 0x5555556b2b30 - tokio::coop::with_budget::{{closure}}::h404b3b890380a49f at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/coop.rs:102:9 43: 0x555555722c80 - std::thread::local::LocalKey::try_with::hc7e9738795fc0626 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/thread/local.rs:445:16 44: 0x555555720dee - std::thread::local::LocalKey::with::h2cb5e0d122fc9d7a at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/thread/local.rs:421:9 45: 0x555555717850 - tokio::coop::with_budget::h8ffc1faf54a65420 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/coop.rs:95:5 46: 0x555555717850 - tokio::coop::budget::h32d443ad84cb42ee at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/coop.rs:72:5 47: 0x555555717850 - tokio::runtime::scheduler::multi_thread::worker::Context::run_task::he8a004214783ca87 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/scheduler/multi_thread/worker.rs:420:9 48: 0x5555557170d6 - tokio::runtime::scheduler::multi_thread::worker::Context::run::h61d733a2230750ba at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/scheduler/multi_thread/worker.rs:387:24 49: 0x555555716ebd - tokio::runtime::scheduler::multi_thread::worker::run::{{closure}}::h5710355e47d5fb35 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/scheduler/multi_thread/worker.rs:372:17 50: 0x5555557148a7 - tokio::macros::scoped_tls::ScopedKey::set::hc2ed74bad8d61a4f at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/macros/scoped_tls.rs:61:9 51: 0x555555716dfa - tokio::runtime::scheduler::multi_thread::worker::run::h7e3c19ce0abfa058 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/scheduler/multi_thread/worker.rs:369:5 52: 0x555555716c3b - tokio::runtime::scheduler::multi_thread::worker::Launch::launch::{{closure}}::hb0624a9e439673e4 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/scheduler/multi_thread/worker.rs:348:45 53: 0x5555556ab923 - <tokio::runtime::blocking::task::BlockingTask as core::future::future::Future>::poll::ha279c5821cd1e0f4 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/blocking/task.rs:42:21 54: 0x5555556cf6b0 - tokio::runtime::task::core::CoreStage::poll::{{closure}}::h3c05e7c20ca86385 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/core.rs:184:17 55: 0x5555556c80a0 - tokio::loom::std::unsafe_cell::UnsafeCell::with_mut::h4d77b421bec4aa12 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/loom/std/unsafe_cell.rs:14:9 56: 0x5555556cf548 - tokio::runtime::task::core::CoreStage::poll::h07d4685630622bf9 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/core.rs:174:13 57: 0x5555557201c8 - tokio::runtime::task::harness::poll_future::{{closure}}::h6b5d305cbb9fdfb6 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/harness.rs:480:19 58: 0x55555569c953 - <core::panic::unwind_safe::AssertUnwindSafe as core::ops::function::FnOnce<()>>::call_once::h8253cee07dcaee71 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/panic/unwind_safe.rs:271:9 59: 0x55555573bbd2 - std::panicking::try::do_call::h75ee1e8106d24b7d at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:492:40 60: 0x55555573c97b - rust_try 61: 0x55555573aa66 - std::panicking::try::h00925be4973b9ce4 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:456:19 62: 0x55555573358b - std::panic::catch_unwind::h08ea8bc90e65875a at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panic.rs:137:14 63: 0x55555571ff0e - tokio::runtime::task::harness::poll_future::h6f7ad96c834f4ff6 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/harness.rs:468:18 64: 0x55555571e369 - tokio::runtime::task::harness::Harness<T,S>::poll_inner::h52e898622092e79e at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/harness.rs:104:27 65: 0x55555571ddc4 - tokio::runtime::task::harness::Harness<T,S>::poll::h0523ddaa6489c43b at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/harness.rs:57:15 66: 0x5555556e0442 - tokio::runtime::task::raw::poll::h7e525a5215f2c060 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/raw.rs:194:5 67: 0x5555556e034f - tokio::runtime::task::raw::RawTask::poll::h2f99aff06af6e3a7 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/raw.rs:134:18 68: 0x5555556d0304 - tokio::runtime::task::UnownedTask::run::h8e21c74ca14f0d6a at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/task/mod.rs:422:9 69: 0x5555556ebd17 - tokio::runtime::blocking::pool::Task::run::h312d097a9af7c901 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/blocking/pool.rs:111:9 70: 0x5555556ee40c - tokio::runtime::blocking::pool::Inner::run::h5ccc53e5bf1058b4 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/blocking/pool.rs:346:17 71: 0x5555556ed807 - tokio::runtime::blocking::pool::Spawner::spawn_thread::{{closure}}::h6bc9490258475307 at /home/roman/.cargo/registry/src/github.com-1ecc6299db9ec823/tokio-1.21.2/src/runtime/blocking/pool.rs:321:13 72: 0x55555569cbee - std::sys_common::backtrace::rust_begin_short_backtrace::h3d4c404e5aef540c at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/sys_common/backtrace.rs:122:18 73: 0x55555569dee2 - std::thread::Builder::spawnunchecked::{{closure}}::{{closure}}::hb3613c45395f5c63 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/thread/mod.rs:505:17 74: 0x55555569ca22 - <core::panic::unwind_safe::AssertUnwindSafe as core::ops::function::FnOnce<()>>::call_once::hb8c4b570c00d0a55 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/panic/unwind_safe.rs:271:9 75: 0x55555573bb44 - std::panicking::try::do_call::h6dc208d38e2dc48d at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:492:40 76: 0x55555573c97b - __rust_try 77: 0x55555573af20 - std::panicking::try::h61bae38ced0c518e at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panicking.rs:456:19 78: 0x555555733632 - std::panic::catch_unwind::h146004fa0d735b98 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/panic.rs:137:14 79: 0x55555569dcdf - std::thread::Builder::spawnunchecked::{{closure}}::ha25b0aedaeeee137 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/thread/mod.rs:504:30 80: 0x5555556d35df - core::ops::function::FnOnce::call_once{{vtable.shim}}::h1bc1368997c17b72 at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/core/src/ops/function.rs:248:5 81: 0x55555580e293 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce>::call_once::h56d5fc072706762b at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/alloc/src/boxed.rs:1935:9 82: 0x55555580e293 - <alloc::boxed::Box<F,A> as core::ops::function::FnOnce>::call_once::h41deef8e33b824bb at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/alloc/src/boxed.rs:1935:9 83: 0x55555580e293 - std::sys::unix::thread::Thread::new::thread_start::ha6436304a1170bba at /rustc/a55dd71d5fb0ec5a6a3a9e8c27b2127ba491ce52/library/std/src/sys/unix/thread.rs:108:17 84: 0x7ffff779b6db - start_thread at /build/glibc-CVJwZb/glibc-2.27/nptl/pthread_create.c:463 85: 0x7ffff6f2261f - clone at /build/glibc-CVJwZb/glibc-2.27/misc/../sysdeps/unix/sysv/linux/x86_64/clone.S:95 86: 0x0 -

harlanc commented 1 year ago

Because the timestamp is overflow:

 self.current_message_header().timestamp += extended_timestamp - 0xFFFFFF;
rutmir commented 1 year ago

do you need additional information from my side, to fix this issue?

rutmir commented 1 year ago

self.current_message_header().timestamp: 1022 extended_timestamp: 4294967175   both approaches: self.current_message_header().timestamp += extended_timestamp - 0xFFFFFF; self.current_message_header().timestamp -= 0xFFFFFF + extended_timestamp;   lead to error thread 'tokio-runtime-worker' panicked at 'attempt to add with overflow'

harlanc commented 1 year ago

The following will work:

     let mut timestamp = self.current_message_header().timestamp as i64;
     timestamp += (extended_timestamp as i64 - 0xFFFFFF);
     self.current_message_header().timestamp = timestamp as u32;
rutmir commented 1 year ago

Thank you, look like code in CASE 2 also should be rewrited using this approach. Couple moments: a lot of requests to not implemented CASE 3, and new issue in fn read_message_payload - thread 'tokio-runtime-worker' panicked at 'attempt to subtract with overflow' in code: let remaining_bytes = whole_msg_length - self.current_chunk_info.payload.len(); at panic moment: whole_msg_length: 88, payload_length: 4224

harlanc commented 1 year ago

Can you provide the recoding file(flv) to reproduce the problem? Which device or software do you use to push a RTMP stream?

rutmir commented 1 year ago

I am using device (mavic DJI mini 2)

rutmir commented 1 year ago

I switched back code to original version, look like new version hide problem. I turned on trace logs, the first thought, read_message_payload function not completed properly. sorry for big trace:

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8401 [ TRACE unpacketizer] read_message_payload buffer len:197 [ TRACE unpacketizer] read_message_payload current msg payload len:164864 [ TRACE unpacketizer] read_message_header, left bytes length: 68 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8273 [ TRACE unpacketizer] read_message_payload buffer len:68 [ TRACE unpacketizer] read chunks end, current time: 1666986473496183385, and read state: 4 [ TRACE tokio_util::codec::framed_impl] attempting to decode a frame [ TRACE tokio_util::codec::framed_impl] attempting to decode a frame [ TRACE tokio_util::codec::framed_impl] frame decoded from buffer [ TRACE unpacketizer] read chunks begin, current time: 1666986473496716090, and read state: 4 [ TRACE unpacketizer] read chunk begin, current time: 1666986473496820004, and read state: 4, and chunk index: 95 [ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8273 [ TRACE unpacketizer] read_message_payload buffer len:8260 [ TRACE unpacketizer] read_message_payload current msg payload len:164992 [ TRACE unpacketizer] read_message_header, left bytes length: 8131 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8145 [ TRACE unpacketizer] read_message_payload buffer len:8131 [ TRACE unpacketizer] read_message_payload current msg payload len:165120 [ TRACE unpacketizer] read_message_header, left bytes length: 8002 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8017 [ TRACE unpacketizer] read_message_payload buffer len:8002 [ TRACE unpacketizer] read_message_payload current msg payload len:165248 [ TRACE unpacketizer] read_message_header, left bytes length: 7873 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7889 [ TRACE unpacketizer] read_message_payload buffer len:7873 [ TRACE unpacketizer] read_message_payload current msg payload len:165376 [ TRACE unpacketizer] read_message_header, left bytes length: 7744 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7761 [ TRACE unpacketizer] read_message_payload buffer len:7744 [ TRACE unpacketizer] read_message_payload current msg payload len:165504 [ TRACE unpacketizer] read_message_header, left bytes length: 7615 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7633 [ TRACE unpacketizer] read_message_payload buffer len:7615 [ TRACE unpacketizer] read_message_payload current msg payload len:165632 [ TRACE unpacketizer] read_message_header, left bytes length: 7486 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7505 [ TRACE unpacketizer] read_message_payload buffer len:7486 [ TRACE unpacketizer] read_message_payload current msg payload len:165760 [ TRACE unpacketizer] read_message_header, left bytes length: 7357 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7377 [ TRACE unpacketizer] read_message_payload buffer len:7357 [ TRACE unpacketizer] read_message_payload current msg payload len:165888 [ TRACE unpacketizer] read_message_header, left bytes length: 7228 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7249 [ TRACE unpacketizer] read_message_payload buffer len:7228 [ TRACE unpacketizer] read_message_payload current msg payload len:166016 [ TRACE unpacketizer] read_message_header, left bytes length: 7099 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7121 [ TRACE unpacketizer] read_message_payload buffer len:7099 [ TRACE unpacketizer] read_message_payload current msg payload len:166144 [ TRACE unpacketizer] read_message_header, left bytes length: 6970 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6993 [ TRACE unpacketizer] read_message_payload buffer len:6970 [ TRACE unpacketizer] read_message_payload current msg payload len:166272 [ TRACE unpacketizer] read_message_header, left bytes length: 6841 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6865 [ TRACE unpacketizer] read_message_payload buffer len:6841 [ TRACE unpacketizer] read_message_payload current msg payload len:166400 [ TRACE unpacketizer] read_message_header, left bytes length: 6712 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6737 [ TRACE unpacketizer] read_message_payload buffer len:6712 [ TRACE unpacketizer] read_message_payload current msg payload len:166528 [ TRACE unpacketizer] read_message_header, left bytes length: 6583 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6609 [ TRACE unpacketizer] read_message_payload buffer len:6583 [ TRACE unpacketizer] read_message_payload current msg payload len:166656 [ TRACE unpacketizer] read_message_header, left bytes length: 6454 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6481 [ TRACE unpacketizer] read_message_payload buffer len:6454 [ TRACE unpacketizer] read_message_payload current msg payload len:166784 [ TRACE unpacketizer] read_message_header, left bytes length: 6325 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6353 [ TRACE unpacketizer] read_message_payload buffer len:6325 [ TRACE unpacketizer] read_message_payload current msg payload len:166912 [ TRACE unpacketizer] read_message_header, left bytes length: 6196 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6225 [ TRACE unpacketizer] read_message_payload buffer len:6196 [ TRACE unpacketizer] read_message_payload current msg payload len:167040 [ TRACE unpacketizer] read_message_header, left bytes length: 6067 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6097 [ TRACE unpacketizer] read_message_payload buffer len:6067 [ TRACE unpacketizer] read_message_payload current msg payload len:167168 [ TRACE unpacketizer] read_message_header, left bytes length: 5938 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5969 [ TRACE unpacketizer] read_message_payload buffer len:5938 [ TRACE unpacketizer] read_message_payload current msg payload len:167296 [ TRACE unpacketizer] read_message_header, left bytes length: 5809 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5841 [ TRACE unpacketizer] read_message_payload buffer len:5809 [ TRACE unpacketizer] read_message_payload current msg payload len:167424 [ TRACE unpacketizer] read_message_header, left bytes length: 5680 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5713 [ TRACE unpacketizer] read_message_payload buffer len:5680 [ TRACE unpacketizer] read_message_payload current msg payload len:167552 [ TRACE unpacketizer] read_message_header, left bytes length: 5551 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5585 [ TRACE unpacketizer] read_message_payload buffer len:5551 [ TRACE unpacketizer] read_message_payload current msg payload len:167680 [ TRACE unpacketizer] read_message_header, left bytes length: 5422 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5457 [ TRACE unpacketizer] read_message_payload buffer len:5422 [ TRACE unpacketizer] read_message_payload current msg payload len:167808 [ TRACE unpacketizer] read_message_header, left bytes length: 5293 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5329 [ TRACE unpacketizer] read_message_payload buffer len:5293 [ TRACE unpacketizer] read_message_payload current msg payload len:167936 [ TRACE unpacketizer] read_message_header, left bytes length: 5164 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5201 [ TRACE unpacketizer] read_message_payload buffer len:5164 [ TRACE unpacketizer] read_message_payload current msg payload len:168064 [ TRACE unpacketizer] read_message_header, left bytes length: 5035 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5073 [ TRACE unpacketizer] read_message_payload buffer len:5035 [ TRACE unpacketizer] read_message_payload current msg payload len:168192 [ TRACE unpacketizer] read_message_header, left bytes length: 4906 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4945 [ TRACE unpacketizer] read_message_payload buffer len:4906 [ TRACE unpacketizer] read_message_payload current msg payload len:168320 [ TRACE unpacketizer] read_message_header, left bytes length: 4777 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4817 [ TRACE unpacketizer] read_message_payload buffer len:4777 [ TRACE unpacketizer] read_message_payload current msg payload len:168448 [ TRACE unpacketizer] read_message_header, left bytes length: 4648 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4689 [ TRACE unpacketizer] read_message_payload buffer len:4648 [ TRACE unpacketizer] read_message_payload current msg payload len:168576 [ TRACE unpacketizer] read_message_header, left bytes length: 4519 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4561 [ TRACE unpacketizer] read_message_payload buffer len:4519 [ TRACE unpacketizer] read_message_payload current msg payload len:168704 [ TRACE unpacketizer] read_message_header, left bytes length: 4390 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4433 [ TRACE unpacketizer] read_message_payload buffer len:4390 [ TRACE unpacketizer] read_message_payload current msg payload len:168832 [ TRACE unpacketizer] read_message_header, left bytes length: 4261 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4305 [ TRACE unpacketizer] read_message_payload buffer len:4261 [ TRACE unpacketizer] read_message_payload current msg payload len:168960 [ TRACE unpacketizer] read_message_header, left bytes length: 4132 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4177 [ TRACE unpacketizer] read_message_payload buffer len:4132 [ TRACE unpacketizer] read_message_payload current msg payload len:169088 [ TRACE unpacketizer] read_message_header, left bytes length: 4003 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4049 [ TRACE unpacketizer] read_message_payload buffer len:4003 [ TRACE unpacketizer] read_message_payload current msg payload len:169216 [ TRACE unpacketizer] read_message_header, left bytes length: 3874 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3921 [ TRACE unpacketizer] read_message_payload buffer len:3874 [ TRACE unpacketizer] read_message_payload current msg payload len:169344 [ TRACE unpacketizer] read_message_header, left bytes length: 3745 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3793 [ TRACE unpacketizer] read_message_payload buffer len:3745 [ TRACE unpacketizer] read_message_payload current msg payload len:169472 [ TRACE unpacketizer] read_message_header, left bytes length: 3616 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3665 [ TRACE unpacketizer] read_message_payload buffer len:3616 [ TRACE unpacketizer] read_message_payload current msg payload len:169600 [ TRACE unpacketizer] read_message_header, left bytes length: 3487 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3537 [ TRACE unpacketizer] read_message_payload buffer len:3487 [ TRACE unpacketizer] read_message_payload current msg payload len:169728 [ TRACE unpacketizer] read_message_header, left bytes length: 3358 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3409 [ TRACE unpacketizer] read_message_payload buffer len:3358 [ TRACE unpacketizer] read_message_payload current msg payload len:169856 [ TRACE unpacketizer] read_message_header, left bytes length: 3229 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3281 [ TRACE unpacketizer] read_message_payload buffer len:3229 [ TRACE unpacketizer] read_message_payload current msg payload len:169984 [ TRACE unpacketizer] read_message_header, left bytes length: 3100 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3153 [ TRACE unpacketizer] read_message_payload buffer len:3100 [ TRACE unpacketizer] read_message_payload current msg payload len:170112 [ TRACE unpacketizer] read_message_header, left bytes length: 2971 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3025 [ TRACE unpacketizer] read_message_payload buffer len:2971 [ TRACE unpacketizer] read_message_payload current msg payload len:170240 [ TRACE unpacketizer] read_message_header, left bytes length: 2842 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2897 [ TRACE unpacketizer] read_message_payload buffer len:2842 [ TRACE unpacketizer] read_message_payload current msg payload len:170368 [ TRACE unpacketizer] read_message_header, left bytes length: 2713 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2769 [ TRACE unpacketizer] read_message_payload buffer len:2713 [ TRACE unpacketizer] read_message_payload current msg payload len:170496 [ TRACE unpacketizer] read_message_header, left bytes length: 2584 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2641 [ TRACE unpacketizer] read_message_payload buffer len:2584 [ TRACE unpacketizer] read_message_payload current msg payload len:170624 [ TRACE unpacketizer] read_message_header, left bytes length: 2455 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2513 [ TRACE unpacketizer] read_message_payload buffer len:2455 [ TRACE unpacketizer] read_message_payload current msg payload len:170752 [ TRACE unpacketizer] read_message_header, left bytes length: 2326 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2385 [ TRACE unpacketizer] read_message_payload buffer len:2326 [ TRACE unpacketizer] read_message_payload current msg payload len:170880 [ TRACE unpacketizer] read_message_header, left bytes length: 2197 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2257 [ TRACE unpacketizer] read_message_payload buffer len:2197 [ TRACE unpacketizer] read_message_payload current msg payload len:171008 [ TRACE unpacketizer] read_message_header, left bytes length: 2068 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2129 [ TRACE unpacketizer] read_message_payload buffer len:2068 [ TRACE unpacketizer] read_message_payload current msg payload len:171136 [ TRACE unpacketizer] read_message_header, left bytes length: 1939 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2001 [ TRACE unpacketizer] read_message_payload buffer len:1939 [ TRACE unpacketizer] read_message_payload current msg payload len:171264 [ TRACE unpacketizer] read_message_header, left bytes length: 1810 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1873 [ TRACE unpacketizer] read_message_payload buffer len:1810 [ TRACE unpacketizer] read_message_payload current msg payload len:171392 [ TRACE unpacketizer] read_message_header, left bytes length: 1681 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1745 [ TRACE unpacketizer] read_message_payload buffer len:1681 [ TRACE unpacketizer] read_message_payload current msg payload len:171520 [ TRACE unpacketizer] read_message_header, left bytes length: 1552 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1617 [ TRACE unpacketizer] read_message_payload buffer len:1552 [ TRACE unpacketizer] read_message_payload current msg payload len:171648 [ TRACE unpacketizer] read_message_header, left bytes length: 1423 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1489 [ TRACE unpacketizer] read_message_payload buffer len:1423 [ TRACE unpacketizer] read_message_payload current msg payload len:171776 [ TRACE unpacketizer] read_message_header, left bytes length: 1294 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1361 [ TRACE unpacketizer] read_message_payload buffer len:1294 [ TRACE unpacketizer] read_message_payload current msg payload len:171904 [ TRACE unpacketizer] read_message_header, left bytes length: 1165 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1233 [ TRACE unpacketizer] read_message_payload buffer len:1165 [ TRACE unpacketizer] read_message_payload current msg payload len:172032 [ TRACE unpacketizer] read_message_header, left bytes length: 1036 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1105 [ TRACE unpacketizer] read_message_payload buffer len:1036 [ TRACE unpacketizer] read_message_payload current msg payload len:172160 [ TRACE unpacketizer] read_message_header, left bytes length: 907 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 977 [ TRACE unpacketizer] read_message_payload buffer len:907 [ TRACE unpacketizer] read_message_payload current msg payload len:172288 [ TRACE unpacketizer] read_message_header, left bytes length: 778 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 849 [ TRACE unpacketizer] read_message_payload buffer len:778 [ TRACE unpacketizer] read_message_payload current msg payload len:172416 [ TRACE unpacketizer] read_message_header, left bytes length: 649 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 721 [ TRACE unpacketizer] read_message_payload buffer len:649 [ TRACE unpacketizer] read_message_payload current msg payload len:172544 [ TRACE unpacketizer] read_message_header, left bytes length: 520 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 593 [ TRACE unpacketizer] read_message_payload buffer len:520 [ TRACE unpacketizer] read_message_payload current msg payload len:172672 [ TRACE unpacketizer] read_message_header, left bytes length: 391 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 465 [ TRACE unpacketizer] read_message_payload buffer len:391 [ TRACE unpacketizer] read_message_payload current msg payload len:172800 [ TRACE unpacketizer] read_message_header, left bytes length: 262 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 337 [ TRACE unpacketizer] read_message_payload buffer len:262 [ TRACE unpacketizer] read_message_payload current msg payload len:172928 [ TRACE unpacketizer] read_message_header, left bytes length: 133 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 209 [ TRACE unpacketizer] read_message_payload buffer len:133 [ TRACE unpacketizer] read_message_payload current msg payload len:173056 [ TRACE unpacketizer] read_message_header, left bytes length: 4 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 81 [ TRACE unpacketizer] read_message_payload buffer len:4 [ TRACE unpacketizer] read chunks end, current time: 1666986473600218645, and read state: 4 [ TRACE tokio_util::codec::framed_impl] attempting to decode a frame [ TRACE tokio_util::codec::framed_impl] attempting to decode a frame [ TRACE tokio_util::codec::framed_impl] frame decoded from buffer [ TRACE unpacketizer] read chunks begin, current time: 1666986473601007852, and read state: 4 [ TRACE unpacketizer] read chunk begin, current time: 1666986473601168274, and read state: 4, and chunk index: 96 [ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 81 [ TRACE unpacketizer] read_message_payload buffer len:8196 [ TRACE unpacketizer] read_message_payload current msg payload len:173137 [ TRACE unpacketizer] read chunk end, current time: 1666986473601714923, and read state: 1, and chunk index: 97 [ TRACE unpacketizer] read chunk begin, current time: 1666986473601895037, and read state: 1, and chunk index: 97 [ TRACE unpacketizer] read_message_header, left bytes length: 8114 [ TRACE unpacketizer] read_message_header format 1, msg_length: 95 [ TRACE unpacketizer] read_message_header format 1, msg_type_id: 8 [ INFO unpacketizer] 1 timestamp: 732, extended_timestamp: 4294967131

thread 'tokio-runtime-worker' panicked at 'attempt to add with overflow', protocol/rtmp/src/chunk/unpacketizer.rs:434:21

harlanc commented 1 year ago

Thanks for your trace data, but it looks a little strange because it seems that the client side didn't set the chunk size but use the init value 128, can you grab network packets with the trace logs?

rutmir commented 1 year ago

Not sure, here last piece of data pushed by server_session->read_parse_chunks method to unpacketizer before error: 6727e5851b7547080c5b2d3d8107e4d99a27cc3c66f328253377bd4227b3a607fd00a5217ef95ef5976636e222b81df1a13399bf1bf0980ead54d9bd881e08a0cf9aac04c4c7d42e2093fbbe3087732d2e025be04552f9bc2d2d37d43fc9a04bb0a7c7965c073c47d04d338db0fb83184ea1ba7128b989cadb43c7525369d59b81d5f1aa4c6af90de9d48461a297051bd4820bc16e7e4436147e0bbec71693d8218d542231a9150a55cf7a2a2871a16523c32f85f391ec1b4c24362017fe25b40077cb130dc4ccedaa9bfb25a4edf29f2baea1260a918c8260756bff85786ddb7389e34b2a43a50db813331ff8093cb9f8f78fe060c79656243bc037c782f91d2f877132f4f1ed03751cc7d664a597af3e335c00204ebf11694791e0d3935805df991c8eae7fa6179b2ad4c4cb88c2434da3e114a49080b851d586dad55f5fc897a6a025be12c45b59b50504aec3618d0a9d7e21ad7a10b2c7bcdf9e4ed89279a2ec61c2fe5aeba70624ca533e9be8e6e4d4ef8649d51fcce2c63679c6dc9569ddcfa9526f3d6f5f004b60005ea8748d51a73df87d5e2427a96452b0006e02275961af0d8df47d1debfeca3fdb0f0988a528ce61dec568de3bde9f13435e5a2633838ebaa87624c40caac831946392a45f18a408d4376a65af056e18d13b93672b7d49cf2d609b55f7172240e488ee5493a0da1b95b4830275d4e5684e5a6fc5d1ec234dc84ef6e12b70235239a846dd4034cf885bbe59adf41aabf095c290e6cbde788b5498365df9e45112b3d0ab7cb8b91bcdd62a3681dabbf57224509055a5243cc38fa1f19ac4dc4fa581155862a86cba09e677eb0a05ecc767e6994b9e1660d523142cbf713ab7efb125621a16aee5b1cf4faad58b28602729883eac952f2233a00703c816ffd3d9a4f34bd3575568e5afcbb3e4603d60d3d35fafd4b636fa223043c87c476af80f5e897e860b5d03ae4fea8e0d9b02c33e17c5e26b5757aeb64c50211b3ef6c49416357d4c8b043b4edb5b3e042e635e7fdb5cef2d8b4a272415a31b74ca67a15b9ec21125a7287d19644372df06c6faf85169780c322a20e94023b4102028a70ead64fcab37c2becd2e7e575ef7974a07006d80e186ed21236ade6d8b4a90ef7671a2b28e640a9ee38f5fbab50c998170e2f45f3aafd9898f883340edf8d686c4afc7b086238cda3079384bd6b8fb995717ea8e6369d03001d1e8c4b9cd8f2d2fe5419f56b24274323cf9cc17df278d37a60a7cebc7582fb6ba18aa502c6d548e1ca7d3be6992352fb81c633f7581e9562bc699238bb11e72ddd276d874b012c7165f1ce3b68f0d6a9456822e253816d1da9dc92474f1c274fa862e74ce03bb9bc42ae0f4c93d993c9d846732d139b8f1e630bb1d10336c347cf8307f7579d87056f03a9c52c4c9a28e8ed139914702e4b6a5d8e2efdc98fd550a3ce7a33a121a7f0cfd63795fbb8fb14b44dca5aa85e4b0c3ccee255c7032e8c55fc85dd37c1764a346c941eb4515713159c9a5ded9af80a0428945758137d9a62699c415c5411ac4afc9135ba0b6a26fcf35de8e4696733b447ffeff7725789bc1daf4b0e7edef7e3b69b6eaf67c098d3161a888ffbc1f69560998c0b8c8e0a0d34a4aa742884349b29bdb1ccf71eee0ef07fd30e59fa2ffeb39e77683a6280c74054f245be85d8e7d875273002097954f382e8bcd2cf25092536f96db2350bc9d6506a1ff0453ffc446b74c10fda8d9807aba6e34e25a9cc4be745c6c327d43625cf01b4a115b5bfecbd24f018b51e27cc4d14e8b370eee9bc62644e7d866f1ef7516b420a564458f3518abb378658e8ce5eab2e9fe2c7cabf3cbdfb441f2f5a24eb620f4aceeda4045a45800efb4b9f8f9025a0146dfe6d0c7684b360fd7de45022d9cfb3a8c5acdc498c5560387bdeaf783a7b615428204520902771d1f877af03bb17a6e97692c83e092d6c9657817369db1205dce1774a031af4f34d109a6a4a3ec10310488f67eec0be513ae935224b0d853d8b05d78919ca117d71d7af2cbbc4f8c4e771f552147e4368911892268aa5955db31cbbf3751a18c9f1cd9663cd0a0dc0a0e8bfe27c4ab6085f4038bc7b892a239c02a76d2a30db5c817e1250b6157d27a26e8892fb611a119a1326fabbd736fbaa983dd7f68e0b199daa4422a1038bb2941c01816bbd86ba9e12c6412bb2c355dfb994849cfd297c7b02ea84df31f9b3c75d5ce67390f861fe72a0f7994f417c0ebe9f09d3be4dd51e43beae7ab186916bf74f72543c4e69ff7bc0728f9b25d258a97ae5d7153f1d0b461de81c756393404e0e7f4f1b815ee7f19b14911c7e7a9953975a99f918454c3e1e508139287af1f91c02072377bcfaf713e9715a65963cd01be96349d63cfea9a1b61e7fd299546cf710ed08525421385f0c92de6b9c7a9d9ac10aacfa54798328582b1a780a116d29da4e523c444b9cfa071d3a8cd645ec715254ed833929a697db178537235adac2d9ad6dff8f10dc3cfade02f5d8c77e2ce4edaa301403d6a596455c1e451794958c58067318b511b3fdc0c2ebb462bcd3b2babb9b9abc3397e5083a45925db6d42492c1f8a4d221ea8c8acc3aea38f405b584f8c3614f6bd0d43d27685b51ec58a28840887c47a1cae2651f4c9eaad60b8b2bd28e78efcf2896fe608f05bc6bfbd9a29da837736f20421c426f5234cba954262189596efb4f327a4d8a9f1c407ff575d048c06241fbe158d285bbdc18111f13720ac4eccdaf24a1720366153fee932ce860f82475be43a96e191841f1dccdf2c8ba4f27aa3cffa923bfb958497da3328083e3dc46261de7bd41a7d5156055084d86d4c7f4bceb7bf651ba402f2d19bac407571b1f9d79fb31d8c565e163a6bdf514a0003c4b849f71aa3e75c72038f5125d318f1be9cb66c7af46ab7e4bd1439d6d54d1a2756a0441b3cb2b7f7a5ead298d353b2f6e6f743d921b765f846e8dd260f5686ed4a61b8b042745012b9ca11f8ba1cd8c4acbe7d44b47223e7edcd6f5241eab35fef4e3c480fd2c1a0d96d204fb667699b4358a46b03f2b2e83358c6d18a6123cd2b662c332746ebda245ce72b33e325c738928fcb8f3fd5393a77336968b26bfc8f8a52041710dba5b3d60c172d0758b05f4806b9625679c88ef8d8f3f3179b04d67ec9b8460c7e033782c106eef480d3c4720e74dc51b35a1b44062daad76abb3df8335d8f89a33704f2479a99b34d0e2f2e036b67ee15d7d93cf6e2fa70d6f6d61f32f0287d9453e183ff47d186cb9683ad4ad3d9a28048c21a693a6192d4fd47508dde30caefa4519f7145d1f8d8d67134b0c3d6b86ef4f1793fe7a7a7ec4f76b5de9b879e90d6542e94bf3f75c1a653c4e0bba82f1ecb6141c50b669a731254adb5b898e5baca2c288bd42ef2e531dea1d9ab8d2a9fad8eebc63fd5fae6e7229730d9554744ff5f388133bf1164266ebdf8c702169008bf3602d16312f4a4b5e8cf83c3dc467629583237c78b346147bff360af639344d279c4ba016c91d2a5e2be10f25b820aa132c1142eb2836c15bac4c4323c2e35d33cae7846f39397fc86fe97de7aed9ee490d7de61f1e94d42a84d09b46224cd303a137f9b350c18b6f5e601dec1f7d41befc0b63d58634769720437ad49faf284f00b556ec9f55ca3fec9b82cd6ef99d2284a0ca62440e80f3f6ce65e6c8481849fd042da6196489805db0b6ab67ca2576853f2af3c5cfc45aa76c46d2f48a2b4b57ee669054439b7643efdc223b509389e997cd5e293231b270801bba57cea96d0aa112ad7cc232d61bc2afd7dc547a0b8d88eb3c2883cab101564a2a73c6591bc5743126763cc97995568000f69b7c9551588ac07dc286ddb4b85477263e8761a090c2b6d6bef9d7eaa6d0717378ceed90c11107c640b73796918c4fc0af26f9634f8cacc1f2d50aea8828be47dbf668044ffffff00005c08ffffff4caf01010e30a0ed120ea12a4b52b4a8209529ef78106853c7c5c175c7167af477b5c0d0d4d1e5559aa2a029a3503e146fe2b82ad13f096c2295c5b5894507015193575d4f3212325f69e7515d50bca017d5e18201d2a510c75e15c1c084000017af01010a30a24c6d4a55d4866a2884253e574a558e6a76d6757954eadfa2d54b29231c68f1287e2142f8165a0f15406455b88ab29e931f009846b9e081f926a200a2b48df755af2977dc0ae34285543345b5df6743c998da1c19cf074400001800005d08af010110309a488d2889752e22a92841150f4c4a07b6a59f5dfd2e4ef92e2df334f34ea32d6917091431158899a1bb18c842d3cc34ac3de39bb122b430042548c412959b7d0208cdde13507bf33d0b54d6595b4f92ebe68c676f74d1704400001700005c08af0100fc30a8ece21ea579a6a994d00147b9192a35d2af13cc28bfc3ed40b539ef29064b8d6d55ace9f99bb5dbd61b4a89af0b294a6e059e5a270a271e95a5f1d4d9592cb4e600114bdc538432cdae85364eee7ce166eaaa1751e09e4400009900459909270100000000004590419a00340069917ff475f1cf90ce5cd5e0580759a7385aa68e0aa39dfb726fb78c44e3af4c21beafd8cf9c865f50e8e8b84c5fb003c80ff454e2d0c9c676d103f97434eb577172bd2784a00fe3b2d09f183823bd207843fe9b488203a155c827dfcd9ca2ce0a864f14592db0a3b9ca898adfef86d962e4c4acf978c53f2dd81716200b5d58a21037b16d04d8c816025f01c0c14bd0d03aa8d69d8f5b999e65861934977872ef55084c00cb74691fcea174a8db813d93126695401e7c4bb97acc6367eeb033759d537eaaffea17e020e21e26baa92144376fadd464f8fee64df177d8df231e17d45ff7b47beaddc487a60fbcf57775f68823c46d204f32c4400b148e2a15d4c31b5138eb2c78b607562ffbcd4afbf252b52ecd357a21597ebfca531a50d57cb969e83d8203ab0b32b12cba891231c19f0698d983cebbfac97bcf436490a0468182b5d6d0a202c11b797f4929faf83bf65a5a6fb422c65995920c965fbc6a38812ebb8443194ea15435311435eed21410579850c45fcf3d25bf183907ddb96235ca8f4913fe86423c6f18ad2e3ae31b840bacd599f85ab393c5688c388bb54ccec94a9e62a18603229f74a960b4ec27e7a0cf12dd11ba8e632ffa71ae11e9edb888d93ee02a9a8b3da64b29da9afcf227761abbcc4c8df9cc896e1795430e9fe77c365cbee94faf224d195bc0158c1b9f2e8ff76ac41041f268410190c64c586bfa5878ce6e9a9c3584a0ed7710d75c94e1dcd75e09385cfc1eb367b9615e651762d04e5477fa0fb5989108bf4583174f36eb8d7d564a93183410b060a6e0cc8150eadfa801a69727ea3c18683abd02ef93e1bc57491fd6c25834cb18325faff284113b5901ef22b40079a4656f3c89c6a3694fe704c4cbb96dfbecc82bce6901b305eb93f4b512bd2ba2904a47703a23e2f265eefcd728256a2976b7c1a8fb34a3f5e66b80dcc529b59c5a44b2847ba2f8878113d2d63841daea9259528d33ef34e98041caff1b49760bf0eb4d6c84f8b408a3a0e20ace2f2a5b88c00d8cc6b497155b59faa4735e745a3a14f4629f4699cd188ab220c4810eca861f7f8e84b5ef70dbc35d746a04b4eb11a80c6e17e9b0c851eac6f3b2d38844324413aa9a22ebf862189060b5ad05d12f932ef92b8e2698d18c640591c5730cbc22b5339ecc99978317c696dc16c6ed69e3cdc2e35d0de633618e82b95a5d192e4d72b1d7fa1f01a70f82007fd7ed597538110708dcaf18705a6ae8dac468b07c41df6ce5ac694415843df2270a08617ee7163c6df5f0bc8e351dda2a6ffa34d9a6c281f4fa96b6d2e48d197d4abb83f71da2515ba6f90d6dc1d5239e414587aa1fe93c56b734d370c1c0f259262d09ad95343c7b1de19c7b87b4a3ad6bfd51a92c7104eeb8d32f9fa68611f8bbba968518b99707569796609e26ef63f8c4fd382574d6823280e878fbc0b0669335dfd12192e86ff964d07f3fdcb663cb5570f083dae6c927943230047d6d04184193ed767315b3905cbd4dd09c3e93f3bc71a372a646d41774d2f41f7267e81201f75ad8b98a69a0935a4a8c1db892bbbc9f83e9ac10e6fd7d0f1d60b4548b4fa989557305c60c0ec6d602b137f85d7c27c4f0ff782c0efee0f9c16c0bfeacc171c3b77d2152b01eb296c4fed6c6f4c736172e8e013081a792bc4b546532951fc529f75335d6c7c2963d7e7b20c80a75bcffc82450f2429a749a3c3d4ca49b78706f78c10f2c76049e3b60ea7f8cdb1577cf1d0ca81312af91ae8e0fd967b10e269604f80ff5e386fbb0ad738b90ebdfac6ac43c3521d722a477c19bf0d6479d7a18ff1f27eb2e374650ddd7165bc90f68a910cded39d8e973dc7170afaa63c7c69cffc7f279282cb26336cf735940335a97661e032448b8ec7eaa30a48ce25078dc55dce2cc36a0292e11760f7c5272b6947dd3fc4da6894a85ff52195eeb5d98c44c1568b3e028d52be0cbb49916ad2693cec4e672caa7336fc7f32f6551ccd4f20f97de8343a5313738605018a65e4163344b780ef144641f6a1d36e6f1dfe1fc0a915cb8be19e9669c4df628b4ac98a5425409416dbf90f3c3061c5afd392ac9a73009d17c10dcd69698c2cec1f6d22fb2cc690b88990f19b672924933710806290fff69257147896f28dd5e08faa0a9d441c40cc41996d3168e9d16213371149b9f19a5ee94bb46a0ee46fbfe2f192914141c530679558cb718b01451490e39c71688e0f3831aaf7c45f403850314cf19574b745bd7e35d59277a0a69a7e8395bfc983b8552d6fb7ebb90f8e3627dd7adf5db7a7c490730b0ec110099ebf4ae038c609a3a11b6c143a73f6263099d9c974ab7c4729119b2ad836e6fa79cbd323daea54a6ad284bfe6dcd038e6a2592b35b3b33366dc67971cd3a62e98a5ed51e1a6d0a835d5384ce270a1dcd78fc6d2d3dc72e696b16f8cca290b64707181bc93ba18a5fa7e7e8ebdb88a1f257df3f97ee5e51205e69ae3698b6869182c4228e3f35e83f3c1b06904c5df5b73a232534f975925c49abb340e93af6acb77456e4a107c3111f46b6f82594174d41e26b9371f2ea14e435f4d352b255da3e38279d0cfd588cb64e5db697d33e200e9d3e2afd27fb41e4e32a72d3680b234d008d4236ba4d6cbda310140b2457fe3708a5b81eb2f8ce03a269b919bf383e2c47818135c2235b6fad12288fd23672182424ba8ed179455c47e6439593b9e3ea9f7dc86df04224d157a5e538ef3ce9c232b2cde5dc17244ccbe5639832971353e53c93b2d23b969469e8c7fe553f0efb0b88d9261bef89dcd598a5e2777a7a10bf4d775f1dd9dc44897146f16c4a0f934f7f6d66c3d1ca93b33c055b109c88bf10a23754b22bf59d7a0988486d1fa554b8782a667a78aa40dc416c2cb3555e10affe30cb8a8f64d71ab8148de20f22d29dac10c9a1468dc0f3cbad358e117a91a3fb39b7976135f3068e9dfe8dd97e4ed1e5df51671616e29a2185f58521801fc57ac8adbbbe23c967e758e9d4fe2f0d9f92c7d07e0a3b38c095828a88fb2196209957963e78ecfd8bfe4342d1a8d9c4b4bb0f07b2c826c0c9dc457df0ad1abcae5daeacdb8c162fd9ced5037d9eadfd93c0fc51bd3e0fc9e53e71f817ad13363cd6c83790ae685fcfe7a67a58fff498f99360fc4f93a8f28f9ccfed533e4b6883e4cfabd80c2c58b24900a89301b98f7d80b95a280f8e5d3d89dd8591e183be1efb9e0a405ab5ad9444971489f68f868d8af95a8cb0590fd0644c42cbdbe263c76ecbb5104fff2a7d6ab4e5e740413526aaf895aade0b90a972ea095c632814e43128891edfd1e0ee9ea47d79f64974a137ec24b7ed29b2ec05a14d2c75dd87c105f9c9b9fc64f6f3b3b31def5a76d698f5d5758925f65f461da26ab56a6dfeffe7814c121bed54aeccbe9f545d451b289417fb4bff00f51a08015c45eef574ceaeb1421f9ed76bcfb31b1b1a13368f1bd76d76d949532ed3cc86935f835f88cff080e00275b2f2a714e4c692baa9c35d44a6e3cfed22fc8b8c209cb9b597088ac2568635f984171927256e2a36e1428e3fd6e61bdf86f6c85f8967fc299574b54d9fa2e1133c55eea651b8c261c720c104ff87c33acbe12b4f456bbc4051ad211d00de36019ca5e71d86aa42989f7c9dec2e6e93a72fd8a097fe964451d1f9a72736ecb9a38a66455152e575ee0bfe1e18ee37fc62360a4314155458c25ae05891748c6a377c839cccafd4cbd1320c519a4737c98f49980611229b96b2bf703363d90e02798bc5d1ae7b7a03439afe12648a02146df4c314091b5af43c44c5ee17d4a8b860e68fb6c03bc349c44980dcbb07c11d8b8733a12a8aa1b5151a1b66972b4f6864661b253e793787da3271c037428c9623049851d7513da11da1d3e215dd3070218335b1a08abc0dc13989b6efdf015a40cd5e4fba3b1cdfa61f83c1738ae206a2878d7902620546d3a0a79a8f4252081ffc9bdf8e49886d100c4429225360ef9af334645464f2a3b927ac1a614ad4367bf6ab53742ff527567cad4b899e055665c3bdddd2f1205d813b252aef36a8298b94dd48068f952e25e065daf7512d692b3ce2bb181bf39579e96dd621bf1d4a3d0f6d06df7b5c29272b09ca8879b909efb63a743cd8f877b3faa94444e00e2e4b702610a40f481b3227ac4537c34bb8b86f90a47633589ffc9a8b29d5961f93cf2ba5ed51835dddf70fc852062b828675e3bbbb4f05e7b4113029870b995af414b017b892ec84d06f9ecd27e32f2ef30e1870b973daba287dfc2f06a7667bbd481595434c054d160bb63b7d19f4bc9fa4d9c716c2a96eeae949f56a541f0d4afe0a967f69308771586cb8cc428e07a1ad3faf613c08bb890a218d0509b3d3f4d585f229c53eab9ed92942282f212debef6602151edc546f37eb1bc34e8ad4ccb5b6f694d533bd6a4e5293a4e8264fc5487de5800f1db28a1f398e9b4f5f1d031182798b6ca4e21cf9294fd99b51353ce6664ffe69b004b6e3989af42cad7a846882495b3de93b5f3b6cb1b77c4286db4471b37578c980e4ff1ba677b4ac5795c1c92c2aa88105d67745477fde906c9c83885185a94af31bddad31687c86171e1f92c651a2d0a9c5075b03e09995f708bad615eef363de1de25e76263017b4dd35e886f47f41ebf22952f242ed0eaf8e9c7e42689106db37ffc615a8fde83135ce1bf9bd63b8ddb50c6b0812900c494d5e1ca827293bc0b5a5acf4d9151353895d39698ca052042cee67102eb6dc76797d1e468d62893de6fa64f24754e60c1879eb5e1efa96571a57389103c55637d560028c95df5368bac9152dfb6c16d281dca7d6b7f2c40e4a4bf1590f66ddc6b5bb2596806bffac1134afd802f8a95087ebb2c0eadf937af9a4b1cddbacdf4c45ac952aa63fcb1c50520a51591f060e7020321b5cddb4bcc670e4f8ed38ddce88273c2b066652e5920a9395f256884f6222b1c7c1a35ac986e37d7d387e6d1b09fc2258c419aa23fff73df950992a7a2155a9afa80fb260a90822c2c467b40a7789e71cc0533224d67f3b954270778bec005988dcfaa2fa1995a0a10f071863ac4366103087f9834b99c070b4cae8000696def09f7194754e0835d017eedadb2a3d89135f1473bbc9d0cb20f14aa5cb3a5f35c8db97b5a2bf87059a77f86dc552869274702d97cbf017348a791c36387a47859701cec93e3d73f875eaf13915c53d25548b9cd3b5d8438a0f9d7e01324a1d2fc4fa8e4eeab1296c57a855ddb0800c41a041a5d5d8d6660f7712677c8185735497a3298b007b24229bca63e1a8dd72b6f3d275cff9f2db8a57d39ab092c8995b4b3e453bfb897edd127e52d440f30ce4207753daf4a6a341e275242bd03c5a1ae9c8e680aaec193046fc9d7756ba25765ba1d5392c89ea78d17c6798860d6273ca04c0eafb86755d25f9c96b6bb5dffc4000de21cc94079cf574cafccded1ef2c559e37587d4a5758b486839b74247c9949cf0e186cee702f4b44e217e6698c8462b362bf6ccb331888a09b1ce2e662a37c092c89450f33c32aa45c28ea7876d02961fc411a189fb925266ef8de979d7f1aaab94d443b66cefebc1f7e24151ae351c3c81471de6916bd98e173327c2f2cc43bea160b7d52fa6b2850c5116786427506b38d94a876259ee013eb0e1548962fda93848154c4d77ebc9e8f96a4aecc5c1e6ad7aca21f722416f888572ce10b018ce32b64aaf727a56ac9a24ac989baf959271983cde262581cc55dac381178821b1c60edeb3485fe319b9af772b3fdb4b5213fec830b113e0db0e9f5816bd190c4368252d8a49d7ecd250ec4fda0c6d97f9fa72c179e5c3da33fd9d69478740f1da551a758e407fdb5715b59913fd7cd50b41621a595df3d10a711def5b2623eb1d00c34945983725d92d54d5e09be0189244a1d237f61127ee3a4c5df50a02f91aa9092cf41194a84e053fee55ac71c188a790884f9e3c412a59d370d4c8b839cc4d5d3bac56e8660c26bddbe10950618df423d2417efeb04fdad3c199a1d1ab526600a9d60a22f10ca950614db4c7927ef665314237c93f91d04fcfe2274f59d25b17959fb93d668d86d5d04b7d14c9e9e3ed2b72be18be36339696cdfed9052e3f9ba2a41fe1ffa82b59b9cf33c7d955e563baec56c90e603ed23f24b2292533bc48f1331afa9a23e96018bd9e30816ee5723e0b6d7198e156b30eccc97376b2c68e65fa627134ee9ca603e2377218a6bb4850dfd9819a35564ac02a9e84126c1d40b82e6293da5dd4b32986cdfd0eb4d52c291293027a6718030693ca88643e010a6a468a4424ef8b4995a38ff7b464538772879b8981715ad33e21345eb64b7fec4cf99131841688e1a5af1cfc9ef22d304b2a87352e22af58978f4b20689f188e40fa1d8a755dac8f4a0fb20b802eab59a79dc6b3f62e11a84103d5c61a2e6087d459891dc1fe5a16d02982f94a16a456232e55f3e42537eb886b7a034036fcd298cccb22177f072b9fac9426236ef342abd2990ac7d1742229ec2c5f144df339fc4a787138e05edc7716d572346cb1d5de3f26a551dd0b07ed7fd77100eb13a76ac534ea8387d2def23c176b26bd83ce1cc0ecb261f788b775841cc6974042ff2d7796d3aab75082816c2115086fd8a7a7a01b4d7d41565dfe8bff5ce651042e8e5b610fdbdd08d896a140b08e1b412fa7c67993628c843a4c810e2e84ef0635293c46eac05b2ccd6d62ec22efd31075533cfa620ddb46c57227223fea7445704b6778fb79743b96cf5b0f29d59a8cbab71f9c8a122edd8793f385744b4d9ee8d06ef9dd08d0d8b97c09ee30c2d38d7b310d76c628033af291951565cafcc5bf4064c3701181b558ade2244145c13d1920de6e7ad67d9f61b84ea5c44fe261528fdccc4472bf23571f2944b21da107a0af9ddd72165df6772321d487840d2d190b866e8470045f52fe66e49100b2362f8693fba1dfb2c3ab37d6067a479c5125217cfe8cd2a6740c398329580d935a952dad496abf6

I think I can grab all input data (after handshake logic) pushed to unpacketizer, is it required?

harlanc commented 1 year ago

Thanks for the detailed logs, can you grad the network packets using wireshark or tcpdump ? and along with the trace logs , thank you.

rutmir commented 1 year ago

Is this dumps enough? Or you need something else?

harlanc commented 1 year ago

I switched back code to original version, look like new version hide problem. I turned on trace logs, the first thought, read_message_payload function not completed properly. sorry for big trace:

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8401 [ TRACE unpacketizer] read_message_payload buffer len:197 [ TRACE unpacketizer] read_message_payload current msg payload len:164864 [ TRACE unpacketizer] read_message_header, left bytes length: 68 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8273 [ TRACE unpacketizer] read_message_payload buffer len:68 [ TRACE unpacketizer] read chunks end, current time: 1666986473496183385, and read state: 4 [ TRACE tokio_util::codec::framed_impl] attempting to decode a frame [ TRACE tokio_util::codec::framed_impl] attempting to decode a frame [ TRACE tokio_util::codec::framed_impl] frame decoded from buffer [ TRACE unpacketizer] read chunks begin, current time: 1666986473496716090, and read state: 4 [ TRACE unpacketizer] read chunk begin, current time: 1666986473496820004, and read state: 4, and chunk index: 95 [ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8273 [ TRACE unpacketizer] read_message_payload buffer len:8260 [ TRACE unpacketizer] read_message_payload current msg payload len:164992 [ TRACE unpacketizer] read_message_header, left bytes length: 8131 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8145 [ TRACE unpacketizer] read_message_payload buffer len:8131 [ TRACE unpacketizer] read_message_payload current msg payload len:165120 [ TRACE unpacketizer] read_message_header, left bytes length: 8002 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 8017 [ TRACE unpacketizer] read_message_payload buffer len:8002 [ TRACE unpacketizer] read_message_payload current msg payload len:165248 [ TRACE unpacketizer] read_message_header, left bytes length: 7873 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7889 [ TRACE unpacketizer] read_message_payload buffer len:7873 [ TRACE unpacketizer] read_message_payload current msg payload len:165376 [ TRACE unpacketizer] read_message_header, left bytes length: 7744 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7761 [ TRACE unpacketizer] read_message_payload buffer len:7744 [ TRACE unpacketizer] read_message_payload current msg payload len:165504 [ TRACE unpacketizer] read_message_header, left bytes length: 7615 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7633 [ TRACE unpacketizer] read_message_payload buffer len:7615 [ TRACE unpacketizer] read_message_payload current msg payload len:165632 [ TRACE unpacketizer] read_message_header, left bytes length: 7486 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7505 [ TRACE unpacketizer] read_message_payload buffer len:7486 [ TRACE unpacketizer] read_message_payload current msg payload len:165760 [ TRACE unpacketizer] read_message_header, left bytes length: 7357 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7377 [ TRACE unpacketizer] read_message_payload buffer len:7357 [ TRACE unpacketizer] read_message_payload current msg payload len:165888 [ TRACE unpacketizer] read_message_header, left bytes length: 7228 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7249 [ TRACE unpacketizer] read_message_payload buffer len:7228 [ TRACE unpacketizer] read_message_payload current msg payload len:166016 [ TRACE unpacketizer] read_message_header, left bytes length: 7099 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 7121 [ TRACE unpacketizer] read_message_payload buffer len:7099 [ TRACE unpacketizer] read_message_payload current msg payload len:166144 [ TRACE unpacketizer] read_message_header, left bytes length: 6970 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6993 [ TRACE unpacketizer] read_message_payload buffer len:6970 [ TRACE unpacketizer] read_message_payload current msg payload len:166272 [ TRACE unpacketizer] read_message_header, left bytes length: 6841 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6865 [ TRACE unpacketizer] read_message_payload buffer len:6841 [ TRACE unpacketizer] read_message_payload current msg payload len:166400 [ TRACE unpacketizer] read_message_header, left bytes length: 6712 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6737 [ TRACE unpacketizer] read_message_payload buffer len:6712 [ TRACE unpacketizer] read_message_payload current msg payload len:166528 [ TRACE unpacketizer] read_message_header, left bytes length: 6583 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6609 [ TRACE unpacketizer] read_message_payload buffer len:6583 [ TRACE unpacketizer] read_message_payload current msg payload len:166656 [ TRACE unpacketizer] read_message_header, left bytes length: 6454 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6481 [ TRACE unpacketizer] read_message_payload buffer len:6454 [ TRACE unpacketizer] read_message_payload current msg payload len:166784 [ TRACE unpacketizer] read_message_header, left bytes length: 6325 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6353 [ TRACE unpacketizer] read_message_payload buffer len:6325 [ TRACE unpacketizer] read_message_payload current msg payload len:166912 [ TRACE unpacketizer] read_message_header, left bytes length: 6196 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6225 [ TRACE unpacketizer] read_message_payload buffer len:6196 [ TRACE unpacketizer] read_message_payload current msg payload len:167040 [ TRACE unpacketizer] read_message_header, left bytes length: 6067 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 6097 [ TRACE unpacketizer] read_message_payload buffer len:6067 [ TRACE unpacketizer] read_message_payload current msg payload len:167168 [ TRACE unpacketizer] read_message_header, left bytes length: 5938 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5969 [ TRACE unpacketizer] read_message_payload buffer len:5938 [ TRACE unpacketizer] read_message_payload current msg payload len:167296 [ TRACE unpacketizer] read_message_header, left bytes length: 5809 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5841 [ TRACE unpacketizer] read_message_payload buffer len:5809 [ TRACE unpacketizer] read_message_payload current msg payload len:167424 [ TRACE unpacketizer] read_message_header, left bytes length: 5680 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5713 [ TRACE unpacketizer] read_message_payload buffer len:5680 [ TRACE unpacketizer] read_message_payload current msg payload len:167552 [ TRACE unpacketizer] read_message_header, left bytes length: 5551 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5585 [ TRACE unpacketizer] read_message_payload buffer len:5551 [ TRACE unpacketizer] read_message_payload current msg payload len:167680 [ TRACE unpacketizer] read_message_header, left bytes length: 5422 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5457 [ TRACE unpacketizer] read_message_payload buffer len:5422 [ TRACE unpacketizer] read_message_payload current msg payload len:167808 [ TRACE unpacketizer] read_message_header, left bytes length: 5293 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5329 [ TRACE unpacketizer] read_message_payload buffer len:5293 [ TRACE unpacketizer] read_message_payload current msg payload len:167936 [ TRACE unpacketizer] read_message_header, left bytes length: 5164 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5201 [ TRACE unpacketizer] read_message_payload buffer len:5164 [ TRACE unpacketizer] read_message_payload current msg payload len:168064 [ TRACE unpacketizer] read_message_header, left bytes length: 5035 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 5073 [ TRACE unpacketizer] read_message_payload buffer len:5035 [ TRACE unpacketizer] read_message_payload current msg payload len:168192 [ TRACE unpacketizer] read_message_header, left bytes length: 4906 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4945 [ TRACE unpacketizer] read_message_payload buffer len:4906 [ TRACE unpacketizer] read_message_payload current msg payload len:168320 [ TRACE unpacketizer] read_message_header, left bytes length: 4777 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4817 [ TRACE unpacketizer] read_message_payload buffer len:4777 [ TRACE unpacketizer] read_message_payload current msg payload len:168448 [ TRACE unpacketizer] read_message_header, left bytes length: 4648 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4689 [ TRACE unpacketizer] read_message_payload buffer len:4648 [ TRACE unpacketizer] read_message_payload current msg payload len:168576 [ TRACE unpacketizer] read_message_header, left bytes length: 4519 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4561 [ TRACE unpacketizer] read_message_payload buffer len:4519 [ TRACE unpacketizer] read_message_payload current msg payload len:168704 [ TRACE unpacketizer] read_message_header, left bytes length: 4390 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4433 [ TRACE unpacketizer] read_message_payload buffer len:4390 [ TRACE unpacketizer] read_message_payload current msg payload len:168832 [ TRACE unpacketizer] read_message_header, left bytes length: 4261 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4305 [ TRACE unpacketizer] read_message_payload buffer len:4261 [ TRACE unpacketizer] read_message_payload current msg payload len:168960 [ TRACE unpacketizer] read_message_header, left bytes length: 4132 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4177 [ TRACE unpacketizer] read_message_payload buffer len:4132 [ TRACE unpacketizer] read_message_payload current msg payload len:169088 [ TRACE unpacketizer] read_message_header, left bytes length: 4003 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 4049 [ TRACE unpacketizer] read_message_payload buffer len:4003 [ TRACE unpacketizer] read_message_payload current msg payload len:169216 [ TRACE unpacketizer] read_message_header, left bytes length: 3874 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3921 [ TRACE unpacketizer] read_message_payload buffer len:3874 [ TRACE unpacketizer] read_message_payload current msg payload len:169344 [ TRACE unpacketizer] read_message_header, left bytes length: 3745 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3793 [ TRACE unpacketizer] read_message_payload buffer len:3745 [ TRACE unpacketizer] read_message_payload current msg payload len:169472 [ TRACE unpacketizer] read_message_header, left bytes length: 3616 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3665 [ TRACE unpacketizer] read_message_payload buffer len:3616 [ TRACE unpacketizer] read_message_payload current msg payload len:169600 [ TRACE unpacketizer] read_message_header, left bytes length: 3487 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3537 [ TRACE unpacketizer] read_message_payload buffer len:3487 [ TRACE unpacketizer] read_message_payload current msg payload len:169728 [ TRACE unpacketizer] read_message_header, left bytes length: 3358 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3409 [ TRACE unpacketizer] read_message_payload buffer len:3358 [ TRACE unpacketizer] read_message_payload current msg payload len:169856 [ TRACE unpacketizer] read_message_header, left bytes length: 3229 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3281 [ TRACE unpacketizer] read_message_payload buffer len:3229 [ TRACE unpacketizer] read_message_payload current msg payload len:169984 [ TRACE unpacketizer] read_message_header, left bytes length: 3100 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3153 [ TRACE unpacketizer] read_message_payload buffer len:3100 [ TRACE unpacketizer] read_message_payload current msg payload len:170112 [ TRACE unpacketizer] read_message_header, left bytes length: 2971 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 3025 [ TRACE unpacketizer] read_message_payload buffer len:2971 [ TRACE unpacketizer] read_message_payload current msg payload len:170240 [ TRACE unpacketizer] read_message_header, left bytes length: 2842 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2897 [ TRACE unpacketizer] read_message_payload buffer len:2842 [ TRACE unpacketizer] read_message_payload current msg payload len:170368 [ TRACE unpacketizer] read_message_header, left bytes length: 2713 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2769 [ TRACE unpacketizer] read_message_payload buffer len:2713 [ TRACE unpacketizer] read_message_payload current msg payload len:170496 [ TRACE unpacketizer] read_message_header, left bytes length: 2584 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2641 [ TRACE unpacketizer] read_message_payload buffer len:2584 [ TRACE unpacketizer] read_message_payload current msg payload len:170624 [ TRACE unpacketizer] read_message_header, left bytes length: 2455 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2513 [ TRACE unpacketizer] read_message_payload buffer len:2455 [ TRACE unpacketizer] read_message_payload current msg payload len:170752 [ TRACE unpacketizer] read_message_header, left bytes length: 2326 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2385 [ TRACE unpacketizer] read_message_payload buffer len:2326 [ TRACE unpacketizer] read_message_payload current msg payload len:170880 [ TRACE unpacketizer] read_message_header, left bytes length: 2197 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2257 [ TRACE unpacketizer] read_message_payload buffer len:2197 [ TRACE unpacketizer] read_message_payload current msg payload len:171008 [ TRACE unpacketizer] read_message_header, left bytes length: 2068 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2129 [ TRACE unpacketizer] read_message_payload buffer len:2068 [ TRACE unpacketizer] read_message_payload current msg payload len:171136 [ TRACE unpacketizer] read_message_header, left bytes length: 1939 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 2001 [ TRACE unpacketizer] read_message_payload buffer len:1939 [ TRACE unpacketizer] read_message_payload current msg payload len:171264 [ TRACE unpacketizer] read_message_header, left bytes length: 1810 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1873 [ TRACE unpacketizer] read_message_payload buffer len:1810 [ TRACE unpacketizer] read_message_payload current msg payload len:171392 [ TRACE unpacketizer] read_message_header, left bytes length: 1681 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1745 [ TRACE unpacketizer] read_message_payload buffer len:1681 [ TRACE unpacketizer] read_message_payload current msg payload len:171520 [ TRACE unpacketizer] read_message_header, left bytes length: 1552 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1617 [ TRACE unpacketizer] read_message_payload buffer len:1552 [ TRACE unpacketizer] read_message_payload current msg payload len:171648 [ TRACE unpacketizer] read_message_header, left bytes length: 1423 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1489 [ TRACE unpacketizer] read_message_payload buffer len:1423 [ TRACE unpacketizer] read_message_payload current msg payload len:171776 [ TRACE unpacketizer] read_message_header, left bytes length: 1294 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1361 [ TRACE unpacketizer] read_message_payload buffer len:1294 [ TRACE unpacketizer] read_message_payload current msg payload len:171904 [ TRACE unpacketizer] read_message_header, left bytes length: 1165 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1233 [ TRACE unpacketizer] read_message_payload buffer len:1165 [ TRACE unpacketizer] read_message_payload current msg payload len:172032 [ TRACE unpacketizer] read_message_header, left bytes length: 1036 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 1105 [ TRACE unpacketizer] read_message_payload buffer len:1036 [ TRACE unpacketizer] read_message_payload current msg payload len:172160 [ TRACE unpacketizer] read_message_header, left bytes length: 907 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 977 [ TRACE unpacketizer] read_message_payload buffer len:907 [ TRACE unpacketizer] read_message_payload current msg payload len:172288 [ TRACE unpacketizer] read_message_header, left bytes length: 778 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 849 [ TRACE unpacketizer] read_message_payload buffer len:778 [ TRACE unpacketizer] read_message_payload current msg payload len:172416 [ TRACE unpacketizer] read_message_header, left bytes length: 649 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 721 [ TRACE unpacketizer] read_message_payload buffer len:649 [ TRACE unpacketizer] read_message_payload current msg payload len:172544 [ TRACE unpacketizer] read_message_header, left bytes length: 520 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 593 [ TRACE unpacketizer] read_message_payload buffer len:520 [ TRACE unpacketizer] read_message_payload current msg payload len:172672 [ TRACE unpacketizer] read_message_header, left bytes length: 391 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 465 [ TRACE unpacketizer] read_message_payload buffer len:391 [ TRACE unpacketizer] read_message_payload current msg payload len:172800 [ TRACE unpacketizer] read_message_header, left bytes length: 262 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 337 [ TRACE unpacketizer] read_message_payload buffer len:262 [ TRACE unpacketizer] read_message_payload current msg payload len:172928 [ TRACE unpacketizer] read_message_header, left bytes length: 133 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 209 [ TRACE unpacketizer] read_message_payload buffer len:133 [ TRACE unpacketizer] read_message_payload current msg payload len:173056 [ TRACE unpacketizer] read_message_header, left bytes length: 4 [ INFO unpacketizer] read_extended_timestamp -> 3 timestamp: 732, extended_timestamp: 0

[ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 81 [ TRACE unpacketizer] read_message_payload buffer len:4 [ TRACE unpacketizer] read chunks end, current time: 1666986473600218645, and read state: 4 [ TRACE tokio_util::codec::framed_impl] attempting to decode a frame [ TRACE tokio_util::codec::framed_impl] attempting to decode a frame [ TRACE tokio_util::codec::framed_impl] frame decoded from buffer [ TRACE unpacketizer] read chunks begin, current time: 1666986473601007852, and read state: 4 [ TRACE unpacketizer] read chunk begin, current time: 1666986473601168274, and read state: 4, and chunk index: 96 [ TRACE unpacketizer] read_message_payload whole msg length: 173137 and remaining bytes: 81 [ TRACE unpacketizer] read_message_payload buffer len:8196 [ TRACE unpacketizer] read_message_payload current msg payload len:173137 [ TRACE unpacketizer] read chunk end, current time: 1666986473601714923, and read state: 1, and chunk index: 97 [ TRACE unpacketizer] read chunk begin, current time: 1666986473601895037, and read state: 1, and chunk index: 97 [ TRACE unpacketizer] read_message_header, left bytes length: 8114 [ TRACE unpacketizer] read_message_header format 1, msg_length: 95 [ TRACE unpacketizer] read_message_header format 1, msg_type_id: 8 [ INFO unpacketizer] 1 timestamp: 732, extended_timestamp: 4294967131

thread 'tokio-runtime-worker' panicked at 'attempt to add with overflow', protocol/rtmp/src/chunk/unpacketizer.rs:434:21

What's the problem of the new version? Does the crash still occur? How long can the current RTMP pushing last? Can RTMP stream pushed to the xiu server be played out ? Only audio can be played out? or video or Both or neither?

Seems that the DJI does didn't not follow the rules of RTMP? I think it should not use the extend timestamp field since the 3 bytes timestamp can last more than 4 hours

harlanc commented 1 year ago

Have you tried other RTMP media servers?

rutmir commented 1 year ago

Yes, I can do RTMP stream on rtmp://ovsu.mycdn.me/, not sure about audio but video was presented. Your rtmp crate also works and I can connect local server via VLC and view stream, some time several minutes, but it can crash in any moment. And after first crash and restart server and DJI application on mobile phone, next crash comes almost immediately. Not sure, I guess, it possible when DJI application trying to reconnect but RTMP server continue handle it as next data. Yes it is possible than DJI application can work not properly. Any way, not correct data should not bring to rtmp server crush, maybe drop stream / restart stream / clear caching data. Something that allow to reconnect to server and continue to stream.

harlanc commented 1 year ago

Is the rtmp://ovsu.mycdn.me/ server open source? or can you push rtmp stream to it and record it as flv file? ffmpeg can do this

harlanc commented 1 year ago

I can send you the command later if you are not familiar with it

harlanc commented 10 months ago

@rutmir You can try the latest codes to verify the problem..

harlanc commented 10 months ago

please reopen if the problem exists。