fix tsan(thread sanitizer) (fail in startup proton server)

timeplus-io / proton

A streaming SQL engine, a fast and lightweight alternative to ksqlDB and Apache Flink, 🚀 powered by ClickHouse.

Apache License 2.0

1.57k stars 69 forks source link

2023.11.21 03:27:41.091928 [ 948778 ] {} <Information> Context: Initialized background executor for merges and mutations with num_threads=16, num_tasks=32 2023.11.21 03:27:41.094445 [ 948778 ] {} <Information> Context: Initialized background executor for move operations with num_threads=8, num_tasks=8 2023.11.21 03:27:41.096489 [ 948778 ] {} <Information> Context: Initialized background executor for fetches with num_threads=8, num_tasks=8 2023.11.21 03:27:41.098022 [ 948778 ] {} <Information> Context: Initialized background executor for common operations (e.g. clearing old parts) with num_threads=8, num_tasks=8 2023.11.21 03:27:41.099168 [ 948778 ] {} <Information> Application: Loading metadata from ./ 2023.11.21 03:27:41.102572 [ 948778 ] {} <Information> BackgroundSchedulePool/BgSchPool: Create BackgroundSchedulePool with 128 threads 2023.11.21 03:27:41.141794 [ 948778 ] {} <Warning> ExternalGrokPatterns: External grok patterns file 'grok-patterns' does not exist, trying embedded resource 2023.11.21 03:27:41.194493 [ 948778 ] {} <Warning> TelemetryCollector: Please note that telemetry is enabled. This is used to collect the version and runtime environment information to Timeplus, Inc. You can disable it by setting telemetry_enabled to false in config.yaml 2023.11.21 03:27:41.196333 [ 949069 ] {} <Information> LocalFileSystemCheckpoint: Scanning delete-marked and expired checkpoints in checkpoint directory=0835/var/lib/proton/checkpoint/, ttl=604800s 2023.11.21 03:27:41.196966 [ 948778 ] {} <Information> NativeLog: NativeLog init with configs: meta_dir=0835/var/lib/proton/nativelog/meta/ log_dirs=0835/var/lib/proton/nativelog/log check_crcs=false max_schedule_threads=8 max_adhoc_schedule_threads=8 max_cached_entries=10000 max_cached_bytes=419430400 max_cached_entries_per_shard=100 max_cached_bytes_per_shard=4194304 max_wait_ms=500 max_bytes=65536 max_record_size=10485760 segment_size=4294967296 segment_ms=604800000 flush_interval_records=1000 flush_interval_ms=120000 retention_size=-1 retention_ms=604800000 file_delete_delay_ms=300000 max_index_size=10485760 index_interval_bytes=4096 index_interval_records=1000 preallocate=true recovery_threads_per_data_dir=1 flush_check_ms=4294967295 flush_recovery_sn_checkpoint_ms=60000 flush_start_sn_checkpoint_ms=60000 retention_check_ms=300000 num_threads=1 dedup_buffer_size=4194304 dedup_load_factor=0.9 io_buffer_size=1048576 max_io_bytes_per_second=1.7976931348623157e+308 backoff_ms=15000 enable_compactor=true hash_algo=MD5 2023.11.21 03:27:41.197032 [ 948778 ] {} <Information> BackgroundSchedulePool/NLogSched: Create BackgroundSchedulePool with 8 threads 2023.11.21 03:27:41.200559 [ 948778 ] {} <Information> NativeLog: Starting Process 948778 stopped * thread #125, name = 'BgSchPool', stop reason = signal SIGSEGV: invalid address (fault address: 0x0) frame #0: 0x0000000000000000 error: memory read failed for 0x0 (lldb) bt * thread #125, name = 'BgSchPool', stop reason = signal SIGSEGV: invalid address (fault address: 0x0) * frame #0: 0x0000000000000000 frame #1: 0x0000000009fd7554 proton-server`__interceptor___dn_expand + 260 frame #2: 0x00007ffff6403806 libnss_dns.so.2`___lldb_unnamed_symbol66 + 1046 frame #3: 0x00007ffff640532f libnss_dns.so.2`_nss_dns_gethostbyname4_r + 783 frame #4: 0x00007ffff7e8b40f libc.so.6`___lldb_unnamed_symbol3035 + 3903 frame #5: 0x00007ffff7e8cf59 libc.so.6`getaddrinfo + 297 frame #6: 0x0000000009fc75ab proton-server`__interceptor_getaddrinfo + 251 frame #7: 0x00000000238563cd proton-server`Poco::Net::DNS::hostByName(hostname="data.timeplus.com", hintFlags=34) at DNS.cpp:79:11 frame #8: 0x0000000023894f06 proton-server`Poco::Net::SocketAddress::init(this=0x00007ffe7c0f5268, hostAddress="data.timeplus.com", portNumber=443) at SocketAddress.cpp:269:18 frame #9: 0x0000000023894e37 proton-server`Poco::Net::SocketAddress::SocketAddress(this=0x00007ffe7c0f5268, hostAddress="data.timeplus.com", portNumber=443) at SocketAddress.cpp:104:2 frame #10: 0x0000000023860084 proton-server`Poco::Net::HTTPClientSession::reconnect(this=0x00007ffe7c0f5458) at HTTPClientSession.cpp:417:17 frame #11: 0x000000002385efe5 proton-server`Poco::Net::HTTPClientSession::sendRequest(this=0x00007ffe7c0f5458, request=0x00007ffe7c0f5650) at HTTPClientSession.cpp:244:4 frame #12: 0x000000001205661d proton-server`DB::TelemetryCollector::collect(this=0x00000000256581f0) at TelemetryCollector.cpp:133:40 frame #13: 0x0000000012057902 proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0, void ()>>(std::__1::__function::__policy_storage const*) [inlined] DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0::operator()(this=<unavailable>) const at TelemetryCollector.cpp:52:77 frame #14: 0x00000000120578fd proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0, void ()>>(std::__1::__function::__policy_storage const*) [inlined] decltype(std::declval<DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0&>(__f=<unavailable>) at invoke.h:394:23 frame #15: 0x00000000120578fd proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0, void ()>>(std::__1::__function::__policy_storage const*) [inlined] void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0&>(__args=<unavailable>) at invoke.h:479:9 frame #16: 0x00000000120578fd proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0, void ()>>(std::__1::__function::__policy_storage const*) [inlined] std::__1::__function::__default_alloc_func<DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0, void ()>::operator()[abi:v15000](this=<unavailable>) at function.h:235:12 frame #17: 0x00000000120578fd proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::TelemetryCollector::TelemetryCollector(std::__1::shared_ptr<DB::Context const>)::$_0, void ()>>(__buf=0x00007b3400005f58) at function.h:716:16 frame #18: 0x00000000197e1ad3 proton-server`DB::BackgroundSchedulePoolTaskInfo::execute() [inlined] std::__1::__function::__policy_func<void ()>::operator()[abi:v15000](this=0x00007b3400005f58) const at function.h:848:16 frame #19: 0x00000000197e1ac1 proton-server`DB::BackgroundSchedulePoolTaskInfo::execute() [inlined] std::__1::function<void ()>::operator()(this=0x00007b3400005f58) const at function.h:1187:12 frame #20: 0x00000000197e1ac1 proton-server`DB::BackgroundSchedulePoolTaskInfo::execute(this=0x00007b3400005f28) at BackgroundSchedulePool.cpp:105:5 frame #21: 0x00000000197e419c proton-server`DB::BackgroundSchedulePool::threadFunction() [inlined] DB::TaskNotification::execute(this=0x00007b08000efd60) at BackgroundSchedulePool.cpp:18:28 frame #22: 0x00000000197e418a proton-server`DB::BackgroundSchedulePool::threadFunction(this=0x00007b4800004500) at BackgroundSchedulePool.cpp:261:31 frame #23: 0x00000000197e4a06 proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) [inlined] DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0::operator()(this=<unavailable>) const at BackgroundSchedulePool.cpp:151:48 frame #24: 0x00000000197e49fe proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) [inlined] decltype(std::declval<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&>(__f=<unavailable>) at invoke.h:394:23 frame #25: 0x00000000197e49fe proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) [inlined] decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&, std::__1::tuple<>&>(__f=<unavailable>, __t=<unavailable>, (null)=<unavailable>) at tuple:1789:1 frame #26: 0x00000000197e49fe proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) [inlined] decltype(auto) std::__1::apply[abi:v15000]<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&, std::__1::tuple<>&>(__f=<unavailable>, __t=<unavailable>) at tuple:1798:1 frame #27: 0x00000000197e49fe proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) [inlined] ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(this=0x00007b0800057700)::$_0&&)::'lambda'()::operator()() at ThreadPool.h:205:13 frame #28: 0x00000000197e49c5 proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) [inlined] decltype(std::declval<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'()&>(__f=0x00007b0800057700) at invoke.h:394:23 frame #29: 0x00000000197e49c5 proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) [inlined] void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'()&>(__args=0x00007b0800057700) at invoke.h:479:9 frame #30: 0x00000000197e49c5 proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) [inlined] std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000](this=0x00007b0800057700) at function.h:235:12 frame #31: 0x00000000197e49c5 proton-server`void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0>(DB::BackgroundSchedulePool::BackgroundSchedulePool(unsigned long, unsigned long, char const*)::$_0&&)::'lambda'(), void ()>>(__buf=<unavailable>) at function.h:716:16 frame #32: 0x00000000120400d6 proton-server`ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) [inlined] std::__1::__function::__policy_func<void ()>::operator()[abi:v15000](this=0x00007ffe7c0f5fa8) const at function.h:848:16 frame #33: 0x00000000120400cf proton-server`ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) [inlined] std::__1::function<void ()>::operator()(this=0x00007ffe7c0f5fa8) const at function.h:1187:12 frame #34: 0x00000000120400cf proton-server`ThreadPoolImpl<std::__1::thread>::worker(this=0x00007b4400007e40, thread_it=std::__1::list<std::__1::thread, std::__1::allocator<std::__1::thread> >::iterator @ 0x00007ffe7c0f5f20) at ThreadPool.cpp:393:13 frame #35: 0x0000000012044352 proton-server`void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) [inlined] void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(this=<unavailable>)>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const at ThreadPool.cpp:168:73 frame #36: 0x000000001204433d proton-server`void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) [inlined] decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(__f=<unavailable>) at invoke.h:394:23 frame #37: 0x000000001204433d proton-server`void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) [inlined] void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(__t=size=2, (null)=<unavailable>) at thread:284:5 frame #38: 0x000000001204433d proton-server`void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(__vp=0x00007b0800057720) at thread:295:5 frame #39: 0x0000000009fbe3af proton-server`__tsan_thread_start_func + 175 frame #40: 0x00007ffff7f81609 libpthread.so.0`start_thread + 217 frame #41: 0x00007ffff7ea6133 libc.so.6`__clone + 67 (lldb)

2023.11.21 17:50:25.538988 [ 145821 ] {f41c8710-72c6-423b-9cf9-fbd803cca698} <Information> PipelineExecutor: Using 1 threads to execute pipeline for query_id=f41c8710-72c6-423b-9cf9-fbd803cca698 2023.11.21 17:50:25.539445 [ 145232 ] {f41c8710-72c6-423b-9cf9-fbd803cca698} <Information> executeQuery: Read 1 rows, 62.00 B in 0.001433162 sec., 697 rows/sec., 42.25 KiB/sec. 2023.11.21 17:50:25.587622 [ 145820 ] {de6de2ae-645d-4155-b6ae-e98f5cec1174} <Information> PipelineExecutor: Using 14 threads to execute pipeline for query_id=de6de2ae-645d-4155-b6ae-e98f5cec1174 2023.11.21 17:50:25.607457 [ 145233 ] {de6de2ae-645d-4155-b6ae-e98f5cec1174} <Information> executeQuery: Read 4439 rows, 326.82 KiB in 0.063385233 sec., 70032 rows/sec., 5.04 MiB/sec. 2023.11.21 17:50:27.966114 [ 145811 ] {da003653-b99e-4199-b73e-e4b7b918384b} <Information> PipelineExecutor: Using 1 threads to execute pipeline for query_id=da003653-b99e-4199-b73e-e4b7b918384b 2023.11.21 17:50:27.967746 [ 145232 ] {da003653-b99e-4199-b73e-e4b7b918384b} <Information> executeQuery: Read 5 rows, 787.00 B in 0.006452152 sec., 774 rows/sec., 119.12 KiB/sec. ^C2023.11.21 17:50:30.868634 [ 145231 ] {} <Information> Application: Received termination signal (Interrupt) 2023.11.21 17:50:31.842086 [ 145229 ] {} <Information> Application: Closed all listening sockets. 2023.11.21 17:50:31.842208 [ 145229 ] {} <Information> CheckpointCoordinator: Trigger last checkpoint and flush begin 2023.11.21 17:50:31.842306 [ 145229 ] {} <Information> CheckpointCoordinator: Trigger last checkpoint and flush end (elapsed 0 milliseconds) 2023.11.21 17:50:31.842392 [ 145229 ] {} <Information> Application: Closed connections. 2023.11.21 17:50:34.556647 [ 145229 ] {} <Information> Application: Shutting down storages. 2023.11.21 17:50:34.556794 [ 145229 ] {} <Information> TelemetryCollector: Stopped 2023.11.21 17:50:34.556956 [ 145229 ] {} <Information> Context: Shutdown disk default 2023.11.21 17:50:34.714239 [ 145229 ] {} <Information> Application: Closed all listening sockets. 2023.11.21 17:50:34.714299 [ 145229 ] {} <Information> Application: Closed connections to servers for tables. 2023.11.21 17:50:34.717774 [ 145229 ] {} <Information> RaftInstance: shutting down raft core 2023.11.21 17:50:34.717841 [ 145229 ] {} <Information> RaftInstance: sent stop signal to the commit thread. 2023.11.21 17:50:34.717901 [ 145229 ] {} <Information> RaftInstance: cancelled all schedulers. 2023.11.21 17:50:34.717945 [ 145229 ] {} <Information> RaftInstance: commit thread stopped. 2023.11.21 17:50:34.718001 [ 145229 ] {} <Information> RaftInstance: all pending commit elements dropped. 2023.11.21 17:50:34.718040 [ 145229 ] {} <Information> RaftInstance: reset all pointers. 2023.11.21 17:50:34.718087 [ 145229 ] {} <Information> RaftInstance: joined terminated commit thread. 2023.11.21 17:50:34.718239 [ 145229 ] {} <Information> RaftInstance: sent stop signal to background append thread. 2023.11.21 17:50:34.718233 [ 145348 ] {} <Information> RaftInstance: bg append_entries thread terminated 2023.11.21 17:50:34.718472 [ 145229 ] {} <Information> RaftInstance: clean up auto-forwarding queue: 0 elems 2023.11.21 17:50:34.718535 [ 145229 ] {} <Information> RaftInstance: clean up auto-forwarding clients 2023.11.21 17:50:34.718566 [ 145229 ] {} <Information> RaftInstance: raft_server shutdown completed. 2023.11.21 17:50:34.718995 [ 145333 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 19 2023.11.21 17:50:34.718995 [ 145331 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 18 2023.11.21 17:50:34.719027 [ 145336 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 16 2023.11.21 17:50:34.719099 [ 145346 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 15 2023.11.21 17:50:34.719318 [ 145337 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 10 2023.11.21 17:50:34.719959 [ 145339 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 8 2023.11.21 17:50:34.719033 [ 145330 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 16 2023.11.21 17:50:34.720128 [ 145334 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 14 2023.11.21 17:50:34.720040 [ 145327 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 1 2023.11.21 17:50:34.720447 [ 145344 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 4 2023.11.21 17:50:34.719324 [ 145345 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 13 2023.11.21 17:50:34.720714 [ 145342 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 3 2023.11.21 17:50:34.719376 [ 145335 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 11 2023.11.21 17:50:34.720464 [ 145332 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 12 2023.11.21 17:50:34.720480 [ 145341 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 5 2023.11.21 17:50:34.720498 [ 145338 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 9 2023.11.21 17:50:34.720422 [ 145329 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 0 2023.11.21 17:50:34.720823 [ 145340 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 7 2023.11.21 17:50:34.720500 [ 145328 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 2 2023.11.21 17:50:34.720067 [ 145343 ] {} <Information> RaftInstance: end of asio worker thread, remaining threads: 6 2023.11.21 17:50:35.221765 [ 145229 ] {} <Information> Application: shutting down 2023.11.21 17:50:35.223746 [ 145231 ] {} <Information> BaseDaemon: Stop SignalListener thread 2023.11.21 17:50:35.229858 [ 145229 ] {} <Information> KafkaWALPool: Stopping 2023.11.21 17:50:35.229929 [ 145229 ] {} <Information> KafkaWALPool: Stopped 2023.11.21 17:50:35.229975 [ 145229 ] {} <Information> KafkaWALPool: dtored 2023.11.21 17:50:35.230022 [ 145229 ] {} <Information> NativeLog: Stopping 2023.11.21 17:50:35.230826 [ 145229 ] {} <Information> LogManager: Shutting down 2023.11.21 17:50:35.230892 [ 145229 ] {} <Information> LogManager: Flushing and closing logs in proton/build_tsan/programs/proton-data/nativelog/log 2023.11.21 17:50:35.281775 [ 145229 ] {} <Information> LogManager: Shutdown completed 2023.11.21 17:50:35.281865 [ 145229 ] {} <Information> NativeLog: Stopped 2023.11.21 17:50:35.281904 [ 145229 ] {} <Information> NativeLog: dtored ================== WARNING: ThreadSanitizer: data race (pid=145229) Write of size 8 at 0x0000256623d8 by main thread: #0 std::__1::enable_if<is_move_constructible<muduo::net::EventLoop*>::value && is_move_assignable<muduo::net::EventLoop*>::value, void>::type std::__1::swap[abi:v15000]<muduo::net::EventLoop*>(muduo::net::EventLoop*&, muduo::net::EventLoop*&) build_tsan/./contrib/llvm-project/libcxx/include/__utility/swap.h:37:7 (proton+0x1f855bb5) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 std::__1::shared_ptr<muduo::net::EventLoop>::swap[abi:v15000](std::__1::shared_ptr<muduo::net::EventLoop>&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:761:9 (proton+0x1f855bb5) #2 std::__1::shared_ptr<muduo::net::EventLoop>::operator=[abi:v15000](std::__1::shared_ptr<muduo::net::EventLoop>&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:723:38 (proton+0x1f855bb5) #3 DB::TimerService::shutdown() build_tsan/./src/Common/TimerService.cpp:19:16 (proton+0x1f855bb5) #4 DB::CheckpointCoordinator::shutdown() build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:146:19 (proton+0x1f84883f) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 DB::CheckpointCoordinator::~CheckpointCoordinator() build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:127:5 (proton+0x1f84883f) #6 cxa_at_exit_callback_installed_at(void*) crtstuff.c (proton+0xa004469) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 DB::CheckpointCoordinator::instance(std::__1::shared_ptr<DB::Context const>) build_tsan/./src/Checkpoint/CheckpointCoordinator.h:34:9 (proton+0x1203a12d) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) Previous read of size 8 at 0x0000256623d8 by thread T239: #0 std::__1::shared_ptr<muduo::net::EventLoop>::operator->[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:815:16 (proton+0x1f84d891) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 DB::TimerService::runAfter(double, std::__1::function<void ()>) build_tsan/./src/Common/TimerService.h:30:16 (proton+0x1f84d891) #2 DB::CheckpointCoordinator::removeExpiredCheckpoints(bool) build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:387:19 (proton+0x1f84d891) #3 DB::CheckpointCoordinator::startup()::$_0::operator()() const build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:138:36 (proton+0x1f84fe06) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #4 decltype(std::declval<DB::CheckpointCoordinator::startup()::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::CheckpointCoordinator::startup()::$_0&>(DB::CheckpointCoordinator::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1f84fe06) #5 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::CheckpointCoordinator::startup()::$_0&>(DB::CheckpointCoordinator::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1f84fe06) #6 std::__1::__function::__default_alloc_func<DB::CheckpointCoordinator::startup()::$_0, void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1f84fe06) #7 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::CheckpointCoordinator::startup()::$_0, void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1f84fe06) #8 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120431d7) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #9 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120431d7) #10 ThreadPoolImpl<ThreadFromGlobalPool>::worker(std::__1::__list_iterator<ThreadFromGlobalPool, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x120431d7) #11 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x12047cd2) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #12 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047cd2) #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x12047cd2) #14 decltype(auto) std::__1::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x12047cd2) #15 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:202:13 (proton+0x12047cd2) #16 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047b81) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #17 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x12047b81) #18 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x12047b81) #19 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x12047b81) #20 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x12040a33) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #21 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x12040a33) #22 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x12040a33) #23 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x120444d1) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #24 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120444d1) #25 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120444d1) #26 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120444d1) Location is global 'DB::CheckpointCoordinator::instance(std::__1::shared_ptr<DB::Context const>)::ckpt_coordinator' of size 728 at 0x000025662248 (proton+0x256623d8) Thread T239 (tid=145623, running) created by main thread at: #0 pthread_create <null> (proton+0x9fbf44b) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (proton+0x12043dbc) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #2 std::__1::thread::thread<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'(), void>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/thread:311:16 (proton+0x12043dbc) #3 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x1203f27e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #4 ThreadPoolImpl<std::__1::thread>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:173:5 (proton+0x12047106) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./src/Common/ThreadPool.h:183:38 (proton+0x12047106) #6 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x12041586) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 ThreadPoolImpl<ThreadFromGlobalPool>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:173:5 (proton+0x12041ece) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #8 DB::CheckpointCoordinator::startup() build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:138:11 (proton+0x1f848b92) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #9 (anonymous namespace)::initGlobalServices(std::__1::shared_ptr<DB::Context>&) build_tsan/./programs/server/Server.cpp:279:22 (proton+0x1201665e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #10 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&) build_tsan/./programs/server/Server.cpp:1474:5 (proton+0x1201665e) #11 Poco::Util::Application::run() build_tsan/./base/poco/Util/src/Application.cpp:334:8 (proton+0x2392059e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #12 DB::Server::run() build_tsan/./programs/server/Server.cpp:504:25 (proton+0x12007930) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #13 Poco::Util::ServerApplication::run(int, char**) build_tsan/./base/poco/Util/src/ServerApplication.cpp:611:9 (proton+0x2393e6ce) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #14 mainServer(int, char**) build_tsan/./programs/server/Server.cpp:204:20 (proton+0x12004eb6) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #15 main build_tsan/./programs/main.cpp:369:12 (proton+0xa048396) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) SUMMARY: ThreadSanitizer: data race build_tsan/./contrib/llvm-project/libcxx/include/__utility/swap.h:37:7 in std::__1::enable_if<is_move_constructible<muduo::net::EventLoop*>::value && is_move_assignable<muduo::net::EventLoop*>::value, void>::type std::__1::swap[abi:v15000]<muduo::net::EventLoop*>(muduo::net::EventLoop*&, muduo::net::EventLoop*&) ================== ================== WARNING: ThreadSanitizer: data race (pid=145229) Write of size 8 at 0x7b1000020038 by thread T238: #0 operator delete(void*, unsigned long) <null> (proton+0xa0472ff) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 muduo::net::TimerQueue::~TimerQueue() build_tsan/./contrib/muduo/muduo/net/TimerQueue.cc:133:5 (proton+0x23826167) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #2 std::__1::default_delete<muduo::net::TimerQueue>::operator()[abi:v15000](muduo::net::TimerQueue*) const build_tsan/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48:5 (proton+0x2381fd1f) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #3 std::__1::unique_ptr<muduo::net::TimerQueue, std::__1::default_delete<muduo::net::TimerQueue>>::reset[abi:v15000](muduo::net::TimerQueue*) build_tsan/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305:7 (proton+0x2381fd1f) #4 std::__1::unique_ptr<muduo::net::TimerQueue, std::__1::default_delete<muduo::net::TimerQueue>>::~unique_ptr[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259:19 (proton+0x2381fd1f) #5 muduo::net::EventLoop::~EventLoop() build_tsan/./contrib/muduo/muduo/net/EventLoop.cc:123:1 (proton+0x2381fd1f) #6 void std::__1::__destroy_at[abi:v15000]<muduo::net::EventLoop, 0>(muduo::net::EventLoop*) build_tsan/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:63:13 (proton+0x1f8563dd) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 void std::__1::destroy_at[abi:v15000]<muduo::net::EventLoop, 0>(muduo::net::EventLoop*) build_tsan/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:88:5 (proton+0x1f8563dd) #8 void std::__1::allocator_traits<std::__1::allocator<muduo::net::EventLoop>>::destroy[abi:v15000]<muduo::net::EventLoop, void, void>(std::__1::allocator<muduo::net::EventLoop>&, muduo::net::EventLoop*) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317:9 (proton+0x1f8563dd) #9 std::__1::__shared_ptr_emplace<muduo::net::EventLoop, std::__1::allocator<muduo::net::EventLoop>>::__on_zero_shared() build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:309:9 (proton+0x1f8563dd) #10 std::__1::__shared_count::__release_shared[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:174:9 (proton+0x1f855e02) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #11 std::__1::__shared_weak_count::__release_shared[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:215:27 (proton+0x1f855e02) #12 std::__1::shared_ptr<muduo::net::EventLoop>::~shared_ptr[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:702:23 (proton+0x1f855e02) #13 DB::TimerService::startEventLoop() build_tsan/./src/Common/TimerService.cpp:38:1 (proton+0x1f855e02) #14 DB::TimerService::startup()::$_0::operator()() const build_tsan/./src/Common/TimerService.cpp:7:44 (proton+0x1f855ea1) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #15 decltype(std::declval<DB::TimerService::startup()::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::TimerService::startup()::$_0&>(DB::TimerService::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1f855ea1) #16 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::TimerService::startup()::$_0&>(DB::TimerService::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1f855ea1) #17 std::__1::__function::__default_alloc_func<DB::TimerService::startup()::$_0, void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1f855ea1) #18 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::TimerService::startup()::$_0, void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1f855ea1) #19 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120431d7) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #20 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120431d7) #21 ThreadPoolImpl<ThreadFromGlobalPool>::worker(std::__1::__list_iterator<ThreadFromGlobalPool, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x120431d7) #22 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x12047cd2) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #23 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047cd2) #24 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x12047cd2) #25 decltype(auto) std::__1::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x12047cd2) #26 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:202:13 (proton+0x12047cd2) #27 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047b81) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #28 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x12047b81) #29 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x12047b81) #30 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x12047b81) #31 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x12040a33) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #32 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x12040a33) #33 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x12040a33) #34 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x120444d1) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #35 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120444d1) #36 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120444d1) #37 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120444d1) Previous read of size 8 at 0x7b1000020038 by thread T239: #0 muduo::net::Timer::sequence() const build_tsan/./contrib/muduo/muduo/net/Timer.h:44:37 (proton+0x23826415) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 muduo::net::TimerQueue::addTimer(std::__1::function<void ()>, muduo::Timestamp, double) build_tsan/./contrib/muduo/muduo/net/TimerQueue.cc:144:32 (proton+0x23826415) #2 muduo::net::EventLoop::runAt(muduo::Timestamp, std::__1::function<void ()>) build_tsan/./contrib/muduo/muduo/net/EventLoop.cc:210:23 (proton+0x23820f2e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #3 muduo::net::EventLoop::runAfter(double, std::__1::function<void ()>) build_tsan/./contrib/muduo/muduo/net/EventLoop.cc:216:10 (proton+0x23820f2e) #4 DB::TimerService::runAfter(double, std::__1::function<void ()>) build_tsan/./src/Common/TimerService.h:30:28 (proton+0x1f84d8d6) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 DB::CheckpointCoordinator::removeExpiredCheckpoints(bool) build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:387:19 (proton+0x1f84d8d6) #6 DB::CheckpointCoordinator::startup()::$_0::operator()() const build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:138:36 (proton+0x1f84fe06) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 decltype(std::declval<DB::CheckpointCoordinator::startup()::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::CheckpointCoordinator::startup()::$_0&>(DB::CheckpointCoordinator::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1f84fe06) #8 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::CheckpointCoordinator::startup()::$_0&>(DB::CheckpointCoordinator::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1f84fe06) #9 std::__1::__function::__default_alloc_func<DB::CheckpointCoordinator::startup()::$_0, void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1f84fe06) #10 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::CheckpointCoordinator::startup()::$_0, void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1f84fe06) #11 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120431d7) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #12 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120431d7) #13 ThreadPoolImpl<ThreadFromGlobalPool>::worker(std::__1::__list_iterator<ThreadFromGlobalPool, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x120431d7) #14 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x12047cd2) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #15 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047cd2) #16 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x12047cd2) #17 decltype(auto) std::__1::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x12047cd2) #18 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:202:13 (proton+0x12047cd2) #19 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047b81) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #20 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x12047b81) #21 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x12047b81) #22 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x12047b81) #23 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x12040a33) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #24 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x12040a33) #25 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x12040a33) #26 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x120444d1) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #27 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120444d1) #28 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120444d1) #29 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120444d1) Thread T238 (tid=145622, running) created by main thread at: #0 pthread_create <null> (proton+0x9fbf44b) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (proton+0x12043dbc) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #2 std::__1::thread::thread<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'(), void>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/thread:311:16 (proton+0x12043dbc) #3 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x1203f27e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #4 ThreadPoolImpl<std::__1::thread>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:173:5 (proton+0x12047106) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./src/Common/ThreadPool.h:183:38 (proton+0x12047106) #6 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x12041586) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 ThreadPoolImpl<ThreadFromGlobalPool>::scheduleOrThrowOnError(std::__1::function<void ()>, long) build_tsan/./src/Common/ThreadPool.cpp:161:5 (proton+0x120411e4) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #8 DB::TimerService::startup() build_tsan/./src/Common/TimerService.cpp:7:12 (proton+0x1f855a9a) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #9 DB::CheckpointCoordinator::startup() build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:137:19 (proton+0x1f848b6e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #10 (anonymous namespace)::initGlobalServices(std::__1::shared_ptr<DB::Context>&) build_tsan/./programs/server/Server.cpp:279:22 (proton+0x1201665e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #11 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&) build_tsan/./programs/server/Server.cpp:1474:5 (proton+0x1201665e) #12 Poco::Util::Application::run() build_tsan/./base/poco/Util/src/Application.cpp:334:8 (proton+0x2392059e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #13 DB::Server::run() build_tsan/./programs/server/Server.cpp:504:25 (proton+0x12007930) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #14 Poco::Util::ServerApplication::run(int, char**) build_tsan/./base/poco/Util/src/ServerApplication.cpp:611:9 (proton+0x2393e6ce) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #15 mainServer(int, char**) build_tsan/./programs/server/Server.cpp:204:20 (proton+0x12004eb6) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #16 main build_tsan/./programs/main.cpp:369:12 (proton+0xa048396) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) Thread T239 (tid=145623, running) created by main thread at: #0 pthread_create <null> (proton+0x9fbf44b) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (proton+0x12043dbc) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #2 std::__1::thread::thread<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'(), void>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/thread:311:16 (proton+0x12043dbc) #3 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x1203f27e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #4 ThreadPoolImpl<std::__1::thread>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:173:5 (proton+0x12047106) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./src/Common/ThreadPool.h:183:38 (proton+0x12047106) #6 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x12041586) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 ThreadPoolImpl<ThreadFromGlobalPool>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:173:5 (proton+0x12041ece) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #8 DB::CheckpointCoordinator::startup() build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:138:11 (proton+0x1f848b92) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #9 (anonymous namespace)::initGlobalServices(std::__1::shared_ptr<DB::Context>&) build_tsan/./programs/server/Server.cpp:279:22 (proton+0x1201665e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #10 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&) build_tsan/./programs/server/Server.cpp:1474:5 (proton+0x1201665e) #11 Poco::Util::Application::run() build_tsan/./base/poco/Util/src/Application.cpp:334:8 (proton+0x2392059e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #12 DB::Server::run() build_tsan/./programs/server/Server.cpp:504:25 (proton+0x12007930) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #13 Poco::Util::ServerApplication::run(int, char**) build_tsan/./base/poco/Util/src/ServerApplication.cpp:611:9 (proton+0x2393e6ce) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #14 mainServer(int, char**) build_tsan/./programs/server/Server.cpp:204:20 (proton+0x12004eb6) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #15 main build_tsan/./programs/main.cpp:369:12 (proton+0xa048396) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) SUMMARY: ThreadSanitizer: data race (proton/build_tsan/programs/proton+0xa0472ff) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) in operator delete(void*, unsigned long) ================== ThreadSanitizer: reported 2 warnings

================== WARNING: ThreadSanitizer: data race (pid=147811) Read of size 8 at 0x7b0c00157ac0 by thread T330: #0 DB::StreamingStoreSourceBase::doCheckpoint(std::__1::shared_ptr<DB::CheckpointContext const>) build_tsan/./src/Storages/Streaming/StreamingStoreSourceBase.cpp:188:23 (proton+0x1bfd0a93) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 DB::StreamingStoreSourceBase::generate() build_tsan/./src/Storages/Streaming/StreamingStoreSourceBase.cpp:142:16 (proton+0x1bfd07b6) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #2 DB::ISource::tryGenerate() build_tsan/./src/Processors/ISource.cpp:138:18 (proton+0x1b642c74) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #3 DB::ISource::work() build_tsan/./src/Processors/ISource.cpp:103:26 (proton+0x1b6427d3) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #4 DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:46:26 (proton+0x1b681b17) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 DB::ExecutionThreadContext::executeTask() build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:84:9 (proton+0x1b681b17) #6 DB::PipelineExecutor::executeStepImpl(unsigned long, std::__1::atomic<bool>*) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:271:26 (proton+0x1b66cf54) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 DB::PipelineExecutor::executeSingleThread(unsigned long) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:236:5 (proton+0x1b66f800) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #8 DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0::operator()() const build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:373:21 (proton+0x1b66f800) #9 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1b66f800) #10 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x1b66f800) #11 decltype(auto) std::__1::apply[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x1b66f800) #12 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:202:13 (proton+0x1b66f800) #13 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1b66f800) #14 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1b66f800) #15 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1b66f800) #16 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1b66f800) #17 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x12040a33) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #18 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x12040a33) #19 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x12040a33) #20 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x120444d1) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #21 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120444d1) #22 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120444d1) #23 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120444d1) Previous write of size 8 at 0x7b0c00157ac0 by thread T267: #0 operator new(unsigned long) <null> (proton+0xa046967) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 DB::StreamingStoreSourceBase::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>) build_tsan/./src/Storages/Streaming/StreamingStoreSourceBase.cpp:170:16 (proton+0x1bfd0cdd) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #2 DB::ExecutingGraph::triggerCheckpoint(std::__1::shared_ptr<DB::CheckpointContext const>) build_tsan/./src/Processors/Executors/ExecutingGraph.cpp:547:26 (proton+0x1b677086) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #3 DB::PipelineExecutor::triggerCheckpoint(std::__1::shared_ptr<DB::CheckpointContext const>) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:502:12 (proton+0x1b66eb49) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #4 DB::CheckpointCoordinator::doTriggerCheckpoint(std::__1::optional<std::__1::weak_ptr<DB::PipelineExecutor>> const&, std::__1::basic_string_view<char, std::__1::char_traits<char>>, long, std::__1::basic_string_view<char, std::__1::char_traits<char>>) build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:414:23 (proton+0x1f84b644) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long) build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:276:9 (proton+0x1f84ad7a) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #6 DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0::operator()() const build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:278:93 (proton+0x1f850a02) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 decltype(std::declval<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&>(DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1f850a02) #8 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&>(DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1f850a02) #9 std::__1::__function::__default_alloc_func<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0, void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1f850a02) #10 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0, void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1f850a02) #11 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x23825f2b) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #12 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x23825f2b) #13 muduo::net::Timer::run() const build_tsan/./contrib/muduo/muduo/net/Timer.h:39:5 (proton+0x23825f2b) #14 muduo::net::TimerQueue::handleRead() build_tsan/./contrib/muduo/muduo/net/TimerQueue.cc:220:16 (proton+0x23825f2b) #15 decltype(*std::declval<muduo::net::TimerQueue*&>().*std::declval<void (muduo::net::TimerQueue::*&)()>()()) std::__1::__invoke[abi:v15000]<void (muduo::net::TimerQueue::*&)(), muduo::net::TimerQueue*&, void>(void (muduo::net::TimerQueue::*&)(), muduo::net::TimerQueue*&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:359:23 (proton+0x23827d81) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #16 std::__1::__bind_return<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, std::__1::tuple<muduo::Timestamp&&>, __is_valid_bind_return<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, std::__1::tuple<muduo::Timestamp&&>>::value>::type std::__1::__apply_functor[abi:v15000]<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, 0ul, std::__1::tuple<muduo::Timestamp&&>>(void (muduo::net::TimerQueue::*&)(), std::__1::tuple<muduo::net::TimerQueue*>&, std::__1::__tuple_indices<0ul>, std::__1::tuple<muduo::Timestamp&&>&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/bind.h:263:12 (proton+0x23827d81) #17 std::__1::__bind_return<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, std::__1::tuple<muduo::Timestamp&&>, __is_valid_bind_return<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, std::__1::tuple<muduo::Timestamp&&>>::value>::type std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>::operator()[abi:v15000]<muduo::Timestamp>(muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/bind.h:295:20 (proton+0x23827d81) #18 decltype(std::declval<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&>()(std::declval<muduo::Timestamp>())) std::__1::__invoke[abi:v15000]<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&, muduo::Timestamp>(std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&, muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x23827d81) #19 void std::__1::__invoke_void_return_wrapper<void, true>::__call<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&, muduo::Timestamp>(std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&, muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x23827d81) #20 std::__1::__function::__default_alloc_func<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>, void (muduo::Timestamp)>::operator()[abi:v15000](muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x23827d81) #21 void std::__1::__function::__policy_invoker<void (muduo::Timestamp)>::__call_impl<std::__1::__function::__default_alloc_func<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>, void (muduo::Timestamp)>>(std::__1::__function::__policy_storage const*, muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x23827d81) #22 std::__1::__function::__policy_func<void (muduo::Timestamp)>::operator()[abi:v15000](muduo::Timestamp&&) const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x23823741) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #23 std::__1::function<void (muduo::Timestamp)>::operator()(muduo::Timestamp) const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x23823741) #24 muduo::net::Channel::handleEventWithGuard(muduo::Timestamp) build_tsan/./contrib/muduo/muduo/net/Channel.cc:110:24 (proton+0x23823741) #25 muduo::net::Channel::handleEvent(muduo::Timestamp) build_tsan/./contrib/muduo/muduo/net/Channel.cc:79:5 (proton+0x2382331c) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #26 muduo::net::EventLoop::loop() build_tsan/./contrib/muduo/muduo/net/EventLoop.cc:154:30 (proton+0x23820049) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #27 DB::TimerService::startEventLoop() build_tsan/./src/Common/TimerService.cpp:34:17 (proton+0x1f855d85) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #28 DB::TimerService::startup()::$_0::operator()() const build_tsan/./src/Common/TimerService.cpp:7:44 (proton+0x1f855ea1) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #29 decltype(std::declval<DB::TimerService::startup()::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::TimerService::startup()::$_0&>(DB::TimerService::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1f855ea1) #30 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::TimerService::startup()::$_0&>(DB::TimerService::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1f855ea1) #31 std::__1::__function::__default_alloc_func<DB::TimerService::startup()::$_0, void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1f855ea1) #32 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::TimerService::startup()::$_0, void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1f855ea1) #33 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120431d7) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #34 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120431d7) #35 ThreadPoolImpl<ThreadFromGlobalPool>::worker(std::__1::__list_iterator<ThreadFromGlobalPool, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x120431d7) #36 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x12047cd2) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #37 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047cd2) #38 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x12047cd2) #39 decltype(auto) std::__1::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x12047cd2) #40 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:202:13 (proton+0x12047cd2) #41 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047b81) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #42 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x12047b81) #43 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x12047b81) #44 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x12047b81) #45 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x12040a33) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #46 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x12040a33) #47 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x12040a33) #48 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x120444d1) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #49 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120444d1) #50 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120444d1) #51 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120444d1) Location is heap block of size 40 at 0x7b0c00157aa0 allocated by thread T267: #0 operator new(unsigned long) <null> (proton+0xa046967) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 DB::StreamingStoreSourceBase::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>) build_tsan/./src/Storages/Streaming/StreamingStoreSourceBase.cpp:170:16 (proton+0x1bfd0cdd) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #2 DB::ExecutingGraph::triggerCheckpoint(std::__1::shared_ptr<DB::CheckpointContext const>) build_tsan/./src/Processors/Executors/ExecutingGraph.cpp:547:26 (proton+0x1b677086) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #3 DB::PipelineExecutor::triggerCheckpoint(std::__1::shared_ptr<DB::CheckpointContext const>) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:502:12 (proton+0x1b66eb49) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #4 DB::CheckpointCoordinator::doTriggerCheckpoint(std::__1::optional<std::__1::weak_ptr<DB::PipelineExecutor>> const&, std::__1::basic_string_view<char, std::__1::char_traits<char>>, long, std::__1::basic_string_view<char, std::__1::char_traits<char>>) build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:414:23 (proton+0x1f84b644) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long) build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:276:9 (proton+0x1f84ad7a) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #6 DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0::operator()() const build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:278:93 (proton+0x1f850a02) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 decltype(std::declval<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&>(DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1f850a02) #8 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&>(DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1f850a02) #9 std::__1::__function::__default_alloc_func<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0, void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1f850a02) #10 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::CheckpointCoordinator::triggerCheckpoint(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, unsigned long)::$_0, void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1f850a02) #11 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x23825f2b) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #12 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x23825f2b) #13 muduo::net::Timer::run() const build_tsan/./contrib/muduo/muduo/net/Timer.h:39:5 (proton+0x23825f2b) #14 muduo::net::TimerQueue::handleRead() build_tsan/./contrib/muduo/muduo/net/TimerQueue.cc:220:16 (proton+0x23825f2b) #15 decltype(*std::declval<muduo::net::TimerQueue*&>().*std::declval<void (muduo::net::TimerQueue::*&)()>()()) std::__1::__invoke[abi:v15000]<void (muduo::net::TimerQueue::*&)(), muduo::net::TimerQueue*&, void>(void (muduo::net::TimerQueue::*&)(), muduo::net::TimerQueue*&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:359:23 (proton+0x23827d81) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #16 std::__1::__bind_return<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, std::__1::tuple<muduo::Timestamp&&>, __is_valid_bind_return<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, std::__1::tuple<muduo::Timestamp&&>>::value>::type std::__1::__apply_functor[abi:v15000]<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, 0ul, std::__1::tuple<muduo::Timestamp&&>>(void (muduo::net::TimerQueue::*&)(), std::__1::tuple<muduo::net::TimerQueue*>&, std::__1::__tuple_indices<0ul>, std::__1::tuple<muduo::Timestamp&&>&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/bind.h:263:12 (proton+0x23827d81) #17 std::__1::__bind_return<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, std::__1::tuple<muduo::Timestamp&&>, __is_valid_bind_return<void (muduo::net::TimerQueue::*)(), std::__1::tuple<muduo::net::TimerQueue*>, std::__1::tuple<muduo::Timestamp&&>>::value>::type std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>::operator()[abi:v15000]<muduo::Timestamp>(muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/bind.h:295:20 (proton+0x23827d81) #18 decltype(std::declval<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&>()(std::declval<muduo::Timestamp>())) std::__1::__invoke[abi:v15000]<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&, muduo::Timestamp>(std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&, muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x23827d81) #19 void std::__1::__invoke_void_return_wrapper<void, true>::__call<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&, muduo::Timestamp>(std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>&, muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x23827d81) #20 std::__1::__function::__default_alloc_func<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>, void (muduo::Timestamp)>::operator()[abi:v15000](muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x23827d81) #21 void std::__1::__function::__policy_invoker<void (muduo::Timestamp)>::__call_impl<std::__1::__function::__default_alloc_func<std::__1::__bind<void (muduo::net::TimerQueue::*)(), muduo::net::TimerQueue*>, void (muduo::Timestamp)>>(std::__1::__function::__policy_storage const*, muduo::Timestamp&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x23827d81) #22 std::__1::__function::__policy_func<void (muduo::Timestamp)>::operator()[abi:v15000](muduo::Timestamp&&) const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x23823741) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #23 std::__1::function<void (muduo::Timestamp)>::operator()(muduo::Timestamp) const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x23823741) #24 muduo::net::Channel::handleEventWithGuard(muduo::Timestamp) build_tsan/./contrib/muduo/muduo/net/Channel.cc:110:24 (proton+0x23823741) #25 muduo::net::Channel::handleEvent(muduo::Timestamp) build_tsan/./contrib/muduo/muduo/net/Channel.cc:79:5 (proton+0x2382331c) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #26 muduo::net::EventLoop::loop() build_tsan/./contrib/muduo/muduo/net/EventLoop.cc:154:30 (proton+0x23820049) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #27 DB::TimerService::startEventLoop() build_tsan/./src/Common/TimerService.cpp:34:17 (proton+0x1f855d85) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #28 DB::TimerService::startup()::$_0::operator()() const build_tsan/./src/Common/TimerService.cpp:7:44 (proton+0x1f855ea1) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #29 decltype(std::declval<DB::TimerService::startup()::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::TimerService::startup()::$_0&>(DB::TimerService::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1f855ea1) #30 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::TimerService::startup()::$_0&>(DB::TimerService::startup()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1f855ea1) #31 std::__1::__function::__default_alloc_func<DB::TimerService::startup()::$_0, void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1f855ea1) #32 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::TimerService::startup()::$_0, void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1f855ea1) #33 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120431d7) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #34 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120431d7) #35 ThreadPoolImpl<ThreadFromGlobalPool>::worker(std::__1::__list_iterator<ThreadFromGlobalPool, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x120431d7) #36 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x12047cd2) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #37 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047cd2) #38 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x12047cd2) #39 decltype(auto) std::__1::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x12047cd2) #40 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:202:13 (proton+0x12047cd2) #41 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x12047b81) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #42 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x12047b81) #43 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x12047b81) #44 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x12047b81) #45 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x12040a33) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #46 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x12040a33) #47 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x12040a33) #48 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x120444d1) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #49 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120444d1) #50 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120444d1) #51 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120444d1) Thread T330 'QueryPipelineEx' (tid=148508, running) created by main thread at: #0 pthread_create <null> (proton+0x9fbf44b) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (proton+0x12043dbc) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #2 std::__1::thread::thread<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'(), void>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/thread:311:16 (proton+0x12043dbc) #3 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x1203f27e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #4 ThreadPoolImpl<std::__1::thread>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:173:5 (proton+0x12047106) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./src/Common/ThreadPool.h:183:38 (proton+0x12047106) #6 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x12041586) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 ThreadPoolImpl<ThreadFromGlobalPool>::scheduleOrThrowOnError(std::__1::function<void ()>, long) build_tsan/./src/Common/ThreadPool.cpp:161:5 (proton+0x120411e4) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #8 DB::DatabaseOrdinary::startupTables(ThreadPoolImpl<ThreadFromGlobalPool>&, bool, bool) build_tsan/./src/Databases/DatabaseOrdinary.cpp:284:25 (proton+0x19c949a5) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #9 DB::DatabaseAtomic::startupTables(ThreadPoolImpl<ThreadFromGlobalPool>&, bool, bool) build_tsan/./src/Databases/DatabaseAtomic.cpp:440:23 (proton+0x19c881f4) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #10 DB::startupSystemTables() build_tsan/./src/Interpreters/loadMetadata.cpp:220:54 (proton+0x1aa025c8) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #11 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&) build_tsan/./programs/server/Server.cpp:1495:9 (proton+0x12016beb) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #12 Poco::Util::Application::run() build_tsan/./base/poco/Util/src/Application.cpp:334:8 (proton+0x2392059e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #13 DB::Server::run() build_tsan/./programs/server/Server.cpp:504:25 (proton+0x12007930) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #14 Poco::Util::ServerApplication::run(int, char**) build_tsan/./base/poco/Util/src/ServerApplication.cpp:611:9 (proton+0x2393e6ce) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #15 mainServer(int, char**) build_tsan/./programs/server/Server.cpp:204:20 (proton+0x12004eb6) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #16 main build_tsan/./programs/main.cpp:369:12 (proton+0xa048396) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) Thread T267 (tid=148345, running) created by main thread at: #0 pthread_create <null> (proton+0x9fbf44b) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (proton+0x12043dbc) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #2 std::__1::thread::thread<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'(), void>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/thread:311:16 (proton+0x12043dbc) #3 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x1203f27e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #4 ThreadPoolImpl<std::__1::thread>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:173:5 (proton+0x12047106) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #5 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./src/Common/ThreadPool.h:183:38 (proton+0x12047106) #6 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x12041586) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #7 ThreadPoolImpl<ThreadFromGlobalPool>::scheduleOrThrowOnError(std::__1::function<void ()>, long) build_tsan/./src/Common/ThreadPool.cpp:161:5 (proton+0x120411e4) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #8 DB::TimerService::startup() build_tsan/./src/Common/TimerService.cpp:7:12 (proton+0x1f855a9a) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #9 DB::CheckpointCoordinator::startup() build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:137:19 (proton+0x1f848b6e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #10 (anonymous namespace)::initGlobalServices(std::__1::shared_ptr<DB::Context>&) build_tsan/./programs/server/Server.cpp:279:22 (proton+0x1201665e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #11 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&) build_tsan/./programs/server/Server.cpp:1474:5 (proton+0x1201665e) #12 Poco::Util::Application::run() build_tsan/./base/poco/Util/src/Application.cpp:334:8 (proton+0x2392059e) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #13 DB::Server::run() build_tsan/./programs/server/Server.cpp:504:25 (proton+0x12007930) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #14 Poco::Util::ServerApplication::run(int, char**) build_tsan/./base/poco/Util/src/ServerApplication.cpp:611:9 (proton+0x2393e6ce) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #15 mainServer(int, char**) build_tsan/./programs/server/Server.cpp:204:20 (proton+0x12004eb6) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) #16 main build_tsan/./programs/main.cpp:369:12 (proton+0xa048396) (BuildId: 42fda7d9adc08231d24b038dbf638947ec813898) SUMMARY: ThreadSanitizer: data race build_tsan/./src/Storages/Streaming/StreamingStoreSourceBase.cpp:188:23 in DB::StreamingStoreSourceBase::doCheckpoint(std::__1::shared_ptr<DB::CheckpointContext const>) ================== ==================

disk utils

WARNING: ThreadSanitizer: data race (pid=2526131) Read of size 8 at 0x7b0c000823a8 by thread T2: #0 DB::DiskUtilChecker::check(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) const build_tsan/./src/Interpreters/DiskUtilChecker.cpp:41:17 (proton+0x1a1c1b9b) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #1 DB::StorageStream::write(std::__1::shared_ptr<DB::IAST> const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&, std::__1::shared_ptr<DB::Context const>) build_tsan/./src/Storages/Streaming/StorageStream.cpp:1139:41 (proton+0x1bf84c7d) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #2 DB::InterpreterInsertQuery::buildChainLightImpl(std::__1::shared_ptr<DB::IStorage> const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::Block const&, DB::ThreadStatus*, std::__1::atomic<unsigned long>*, bool) build_tsan/./src/Interpreters/InterpreterInsertQuery.cpp:377:24 (proton+0x1a51a5f4) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #3 DB::InterpreterInsertQuery::buildChainImpl(std::__1::shared_ptr<DB::IStorage> const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::Block const&, DB::ThreadStatus*, std::__1::atomic<unsigned long>*, bool) build_tsan/./src/Interpreters/InterpreterInsertQuery.cpp:210:16 (proton+0x1a518f3f) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #4 DB::InterpreterInsertQuery::execute() build_tsan/./src/Interpreters/InterpreterInsertQuery.cpp:522:24 (proton+0x1a51cb01) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #5 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_tsan/./src/Interpreters/executeQuery.cpp:793:36 (proton+0x1a91d3a6) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #6 DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) build_tsan/./src/Interpreters/executeQuery.cpp:1154:30 (proton+0x1a919591) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #7 DB::TCPHandler::runImpl() build_tsan/./src/Server/TCPHandler.cpp:351:24 (proton+0x1b5e33c5) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #8 DB::TCPHandler::run() build_tsan/./src/Server/TCPHandler.cpp:1830:9 (proton+0x1b5f6407) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #9 Poco::Net::TCPServerConnection::start() build_tsan/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (proton+0x238ae062) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #10 Poco::Net::TCPServerDispatcher::run() build_tsan/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (proton+0x238ae8d3) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #11 Poco::PooledThread::run() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:199:14 (proton+0x23bab3c6) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #12 Poco::(anonymous namespace)::RunnableHolder::run() build_tsan/./base/poco/Foundation/src/Thread.cpp:55:11 (proton+0x23ba972f) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #13 Poco::ThreadImpl::runnableEntry(void*) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:345:27 (proton+0x23ba7d87) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) Previous write of size 8 at 0x7b0c000823a8 by thread T308: #0 DB::DiskUtilChecker::updateUtils(std::__1::map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::IDisk>, std::__1::less<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const, std::__1::shared_ptr<DB::IDisk>>>> const&) build_tsan/./src/Interpreters/DiskUtilChecker.cpp:31:26 (proton+0x1a1c1a29) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #1 DB::AsynchronousMetrics::update(std::__1::chrono::time_point<std::__1::chrono::system_clock, std::__1::chrono::duration<long long, std::__1::ratio<1l, 1000000l>>>) build_tsan/./src/Interpreters/AsynchronousMetrics.cpp:1366:44 (proton+0x19dbe7cc) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #2 DB::AsynchronousMetrics::run() build_tsan/./src/Interpreters/AsynchronousMetrics.cpp:349:13 (proton+0x19dc2236) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #3 DB::AsynchronousMetrics::start()::$_0::operator()() const build_tsan/./src/Interpreters/AsynchronousMetrics.cpp:268:62 (proton+0x19dc49bf) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #4 decltype(std::declval<DB::AsynchronousMetrics::start()::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::AsynchronousMetrics::start()::$_0&>(DB::AsynchronousMetrics::start()::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x19dc49bf) #5 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x19dc49bf) #6 decltype(auto) std::__1::apply[abi:v15000]<DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&>(DB::AsynchronousMetrics::start()::$_0&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x19dc49bf) #7 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::AsynchronousMetrics::start()::$_0>(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:202:13 (proton+0x19dc49bf) #8 decltype(std::declval<DB::AsynchronousMetrics::start()::$_0>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::AsynchronousMetrics::start()::$_0>(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(DB::AsynchronousMetrics::start()::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x19dc49bf) #9 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::AsynchronousMetrics::start()::$_0>(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<DB::AsynchronousMetrics::start()::$_0>(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x19dc49bf) #10 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::AsynchronousMetrics::start()::$_0>(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x19dc49bf) #11 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::AsynchronousMetrics::start()::$_0>(DB::AsynchronousMetrics::start()::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x19dc49bf) #12 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x12040a33) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #13 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x12040a33) #14 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:295:17 (proton+0x12040a33) #15 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:140:73 (proton+0x120444d1) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #16 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120444d1) #17 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120444d1) #18 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120444d1) Location is heap block of size 48 at 0x7b0c00082380 allocated by main thread: #0 operator new(unsigned long) <null> (proton+0xa046967) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #1 void* std::__1::__libcpp_operator_new[abi:v15000]<unsigned long>(unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/new:246:10 (proton+0x1a1c26a3) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/new:272:10 (proton+0x1a1c26a3) #3 std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, void*>>::allocate[abi:v15000](unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (proton+0x1a1c26a3) #4 std::__1::allocator_traits<std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, void*>>>::allocate[abi:v15000](std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, void*>>&, unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:262:20 (proton+0x1a1c26a3) #5 std::__1::unique_ptr<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, void*>, std::__1::__hash_node_destructor<std::__1::allocator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, void*>>>> std::__1::__hash_table<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, std::__1::__unordered_map_hasher<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, true>, std::__1::__unordered_map_equal<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, true>, std::__1::allocator<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>>>::__construct_node_hash<std::__1::piecewise_construct_t const&, std::__1::tuple<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>, std::__1::tuple<>>(unsigned long, std::__1::piecewise_construct_t const&, std::__1::tuple<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>&&, std::__1::tuple<>&&) build_tsan/./contrib/llvm-project/libcxx/include/__hash_table:2381:23 (proton+0x1a1c26a3) #6 std::__1::pair<std::__1::__hash_iterator<std::__1::__hash_node<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, void*>*>, bool> std::__1::__hash_table<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, std::__1::__unordered_map_hasher<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, true>, std::__1::__unordered_map_equal<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, true>, std::__1::allocator<std::__1::__hash_value_type<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double>>>::__emplace_unique_key_args<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::piecewise_construct_t const&, std::__1::tuple<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>, std::__1::tuple<>>(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::piecewise_construct_t const&, std::__1::tuple<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>&&, std::__1::tuple<>&&) build_tsan/./contrib/llvm-project/libcxx/include/__hash_table:2013:29 (proton+0x1a1c26a3) #7 std::__1::unordered_map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, double, std::__1::hash<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::equal_to<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const, double>>>::operator[](std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) build_tsan/./contrib/llvm-project/libcxx/include/unordered_map:1804:21 (proton+0x1a1c175a) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #8 DB::DiskUtilChecker::updateUtils(std::__1::map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::shared_ptr<DB::IDisk>, std::__1::less<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const, std::__1::shared_ptr<DB::IDisk>>>> const&) build_tsan/./src/Interpreters/DiskUtilChecker.cpp:31:9 (proton+0x1a1c175a) #9 DB::DiskUtilChecker::DiskUtilChecker(std::__1::shared_ptr<DB::Context const> const&) build_tsan/./src/Interpreters/DiskUtilChecker.cpp:19:5 (proton+0x1a1c175a) #10 DB::DiskUtilChecker::instance(std::__1::shared_ptr<DB::Context const> const&) build_tsan/./src/Interpreters/DiskUtilChecker.h:24:32 (proton+0x120199ba) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #11 (anonymous namespace)::initGlobalSingletons(std::__1::shared_ptr<DB::Context>&) build_tsan/./programs/server/Server.cpp:296:5 (proton+0x120199ba) #12 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&) build_tsan/./programs/server/Server.cpp:1471:5 (proton+0x120199ba) #13 Poco::Util::Application::run() build_tsan/./base/poco/Util/src/Application.cpp:334:8 (proton+0x2392059e) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #14 DB::Server::run() build_tsan/./programs/server/Server.cpp:504:25 (proton+0x12007930) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #15 Poco::Util::ServerApplication::run(int, char**) build_tsan/./base/poco/Util/src/ServerApplication.cpp:611:9 (proton+0x2393e6ce) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #16 mainServer(int, char**) build_tsan/./programs/server/Server.cpp:204:20 (proton+0x12004eb6) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #17 main build_tsan/./programs/main.cpp:369:12 (proton+0xa048396) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) Thread T2 'TCPHandler' (tid=2526134, running) created by main thread at: #0 pthread_create <null> (proton+0x9fbf44b) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr<Poco::Runnable, Poco::ReferenceCounter, Poco::ReleasePolicy<Poco::Runnable>>) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:202:6 (proton+0x23ba779d) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #2 Poco::Thread::start(Poco::Runnable&) build_tsan/./base/poco/Foundation/src/Thread.cpp:128:2 (proton+0x23ba91ac) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #3 Poco::PooledThread::start() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:85:10 (proton+0x23bab8f2) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #4 Poco::ThreadPool::ThreadPool(int, int, int, int) build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:252:12 (proton+0x23bab8f2) #5 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&) build_tsan/./programs/server/Server.cpp:759:22 (proton+0x1200b892) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #6 Poco::Util::Application::run() build_tsan/./base/poco/Util/src/Application.cpp:334:8 (proton+0x2392059e) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #7 DB::Server::run() build_tsan/./programs/server/Server.cpp:504:25 (proton+0x12007930) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #8 Poco::Util::ServerApplication::run(int, char**) build_tsan/./base/poco/Util/src/ServerApplication.cpp:611:9 (proton+0x2393e6ce) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #9 mainServer(int, char**) build_tsan/./programs/server/Server.cpp:204:20 (proton+0x12004eb6) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #10 main build_tsan/./programs/main.cpp:369:12 (proton+0xa048396) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) Thread T308 'AsyncMetrics' (tid=2526450, running) created by main thread at: #0 pthread_create <null> (proton+0x9fbf44b) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (proton+0x12043dbc) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #2 std::__1::thread::thread<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'(), void>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/thread:311:16 (proton+0x12043dbc) #3 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x1203f27e) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #4 ThreadPoolImpl<std::__1::thread>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:173:5 (proton+0x12047106) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #5 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./src/Common/ThreadPool.h:183:38 (proton+0x12047106) #6 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:140:35 (proton+0x12041586) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #7 ThreadPoolImpl<ThreadFromGlobalPool>::scheduleOrThrowOnError(std::__1::function<void ()>, long) build_tsan/./src/Common/ThreadPool.cpp:161:5 (proton+0x120411e4) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #8 DB::DatabaseOrdinary::startupTables(ThreadPoolImpl<ThreadFromGlobalPool>&, bool, bool) build_tsan/./src/Databases/DatabaseOrdinary.cpp:284:25 (proton+0x19c949a5) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #9 DB::DatabaseAtomic::startupTables(ThreadPoolImpl<ThreadFromGlobalPool>&, bool, bool) build_tsan/./src/Databases/DatabaseAtomic.cpp:440:23 (proton+0x19c881f4) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #10 DB::startupSystemTables() build_tsan/./src/Interpreters/loadMetadata.cpp:220:54 (proton+0x1aa025c8) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #11 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&) build_tsan/./programs/server/Server.cpp:1495:9 (proton+0x12016beb) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #12 Poco::Util::Application::run() build_tsan/./base/poco/Util/src/Application.cpp:334:8 (proton+0x2392059e) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #13 DB::Server::run() build_tsan/./programs/server/Server.cpp:504:25 (proton+0x12007930) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #14 Poco::Util::ServerApplication::run(int, char**) build_tsan/./base/poco/Util/src/ServerApplication.cpp:611:9 (proton+0x2393e6ce) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #15 mainServer(int, char**) build_tsan/./programs/server/Server.cpp:204:20 (proton+0x12004eb6) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) #16 main build_tsan/./programs/main.cpp:369:12 (proton+0xa048396) (BuildId: 49650da64cadc593df64bfe49efc8f6d99470033) SUMMARY: ThreadSanitizer: data race build_tsan/./src/Interpreters/DiskUtilChecker.cpp:41:17 in DB::DiskUtilChecker::check(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) const ==================

==================
WARNING: ThreadSanitizer: data race (pid=712381)
  Write of size 8 at 0x7b080050d5e8 by thread T971 (mutexes: write M0, write M1):
    #0 auto DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1::operator()<long>(long&) const build_tsan/./src/Processors/Transforms/Streaming/GlobalAggregatingTransform.cpp:95:73 (proton+0x1d266207) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #1 decltype(std::declval<DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1&>()(std::declval<long&>())) std::__1::__invoke[abi:v15000]<DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1&, long&>(DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1&, long&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1d266207)
    #2 std::__1::invoke_result<DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1&, long&>::type std::__1::invoke<DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1&, long&>(DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1&, long&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:531:12 (proton+0x1d266207)
    #3 std::__1::ranges::in_fun_result<std::__1::__wrap_iter<long*>, DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1> std::__1::ranges::__for_each::__fn::__for_each_impl[abi:v15000]<std::__1::__wrap_iter<long*>, std::__1::__wrap_iter<long*>, std::__1::identity, DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1>(std::__1::__wrap_iter<long*>, std::__1::__wrap_iter<long*>, DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1&, std::__1::identity&) build_tsan/./contrib/llvm-project/libcxx/include/__algorithm/ranges_for_each.h:43:7 (proton+0x1d266207)
    #4 _ZNKSt3__16ranges10__for_each4__fnclB6v15000IRNS_6vectorIlNS_9allocatorIlEEEENS_8identityEZN2DB9Streaming26GlobalAggregatingTransform19prepareFinalizationElE3$_1EENS0_13in_fun_resultINS_7_IfImplIL_ZNS0_14borrowed_rangeIT_EEEE7_SelectIDTclL_ZNS0_5__cpo5beginEEcl7declvalIRSH_EEEENS0_8danglingEEET1_EEOSH_SP_T0_ build_tsan/./contrib/llvm-project/libcxx/include/__algorithm/ranges_for_each.h:63:12 (proton+0x1d266207)
    #5 DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long) build_tsan/./src/Processors/Transforms/Streaming/GlobalAggregatingTransform.cpp:95:9 (proton+0x1d266207)
    #6 DB::Streaming::AggregatingTransform::finalizeAlignment(COW<DB::ChunkContext>::immutable_ptr<DB::ChunkContext> const&) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:315:10 (proton+0x1d250aaa) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #7 DB::Streaming::AggregatingTransform::consume(DB::Chunk) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:163:9 (proton+0x1d2504d7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #8 DB::Streaming::AggregatingTransform::work() build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:130:9 (proton+0x1d250159) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #9 DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:46:26 (proton+0x1c22c037) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #10 DB::ExecutionThreadContext::executeTask() build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:84:9 (proton+0x1c22c037)
    #11 DB::PipelineExecutor::executeStepImpl(unsigned long, std::__1::atomic<bool>*) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:271:26 (proton+0x1c217654) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #12 DB::PipelineExecutor::executeSingleThread(unsigned long) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:236:5 (proton+0x1c219d2a) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #13 DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0::operator()() const build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:373:21 (proton+0x1c219d2a)
    #14 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c219d2a)
    #15 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x1c219d2a)
    #16 decltype(auto) std::__1::apply[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x1c219d2a)
    #17 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:205:13 (proton+0x1c219d2a)
    #18 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c219d2a)
    #19 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1c219d2a)
    #20 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1c219d2a)
    #21 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1c219d2a)
    #22 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120ca695) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #23 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120ca695)
    #24 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:393:13 (proton+0x120ca695)
    #25 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:168:73 (proton+0x120ce911) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #26 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120ce911)
    #27 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120ce911)
    #28 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120ce911)

  Previous read of size 8 at 0x7b080050d5e8 by thread T307:
    #0 __tsan_memcpy <null> (proton+0xa089c20) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #1 DB::WriteBuffer::write(char const*, unsigned long) build_tsan/./src/IO/WriteBuffer.h:90:13 (proton+0xa0fdbb0) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #2 void DB::writePODBinary<long>(long const&, DB::WriteBuffer&) build_tsan/./src/IO/WriteHelpers.h:85:9 (proton+0x1d2542b6) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #3 void DB::writeIntBinary<long>(long const&, DB::WriteBuffer&) build_tsan/./src/IO/WriteHelpers.h:91:5 (proton+0x1d2542b6)
    #4 DB::Streaming::AggregatingTransform::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>)::$_0::operator()(DB::WriteBuffer&) const build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:450:9 (proton+0x1d2542b6)
    #5 decltype(std::declval<DB::Streaming::AggregatingTransform::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>)::$_0&>()(std::declval<DB::WriteBuffer&>())) std::__1::__invoke[abi:v15000]<DB::Streaming::AggregatingTransform::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>)::$_0&, DB::WriteBuffer&>(DB::Streaming::AggregatingTransform::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>)::$_0&, DB::WriteBuffer&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1d2542b6)
    #6 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::Streaming::AggregatingTransform::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>)::$_0&, DB::WriteBuffer&>(DB::Streaming::AggregatingTransform::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>)::$_0&, DB::WriteBuffer&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1d2542b6)
    #7 std::__1::__function::__default_alloc_func<DB::Streaming::AggregatingTransform::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>)::$_0, void (DB::WriteBuffer&)>::operator()[abi:v15000](DB::WriteBuffer&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1d2542b6)
    #8 void std::__1::__function::__policy_invoker<void (DB::WriteBuffer&)>::__call_impl<std::__1::__function::__default_alloc_func<DB::Streaming::AggregatingTransform::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>)::$_0, void (DB::WriteBuffer&)>>(std::__1::__function::__policy_storage const*, DB::WriteBuffer&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1d2542b6)
    #9 std::__1::__function::__policy_func<void (DB::WriteBuffer&)>::operator()[abi:v15000](DB::WriteBuffer&) const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x20535b11) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #10 std::__1::function<void (DB::WriteBuffer&)>::operator()(DB::WriteBuffer&) const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x20535b11)
    #11 DB::LocalFileSystemCheckpoint::checkpoint(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::CheckpointContext const>, std::__1::function<void (DB::WriteBuffer&)>) build_tsan/./src/Checkpoint/LocalFilesystemCheckpoint.cpp:64:5 (proton+0x20535b11)
    #12 DB::CheckpointCoordinator::checkpoint(int, unsigned int, std::__1::shared_ptr<DB::CheckpointContext const>, std::__1::function<void (DB::WriteBuffer&)>) build_tsan/./src/Checkpoint/CheckpointCoordinator.cpp:297:11 (proton+0x2052b510) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #13 DB::Streaming::AggregatingTransform::checkpoint(std::__1::shared_ptr<DB::CheckpointContext const>) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:423:28 (proton+0x1d253c41) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #14 DB::Streaming::AggregatingTransform::checkpointAlignment(std::__1::shared_ptr<DB::CheckpointContext const> const&) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:393:5 (proton+0x1d251b16) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #15 DB::Streaming::AggregatingTransform::consume(DB::Chunk) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:167:9 (proton+0x1d250613) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #16 DB::Streaming::AggregatingTransform::work() build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:130:9 (proton+0x1d250159) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #17 DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:46:26 (proton+0x1c22c037) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #18 DB::ExecutionThreadContext::executeTask() build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:84:9 (proton+0x1c22c037)
    #19 DB::PipelineExecutor::executeStepImpl(unsigned long, std::__1::atomic<bool>*) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:271:26 (proton+0x1c217654) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #20 DB::PipelineExecutor::executeSingleThread(unsigned long) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:236:5 (proton+0x1c219d2a) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #21 DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0::operator()() const build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:373:21 (proton+0x1c219d2a)
    #22 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c219d2a)
    #23 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x1c219d2a)
    #24 decltype(auto) std::__1::apply[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x1c219d2a)
    #25 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:205:13 (proton+0x1c219d2a)
    #26 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c219d2a)
    #27 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1c219d2a)
    #28 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1c219d2a)
    #29 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1c219d2a)
    #30 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120ca695) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #31 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120ca695)
    #32 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:393:13 (proton+0x120ca695)
    #33 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:168:73 (proton+0x120ce911) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #34 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120ce911)
    #35 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120ce911)
    #36 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120ce911)

  Location is heap block of size 24 at 0x7b080050d5e0 allocated by thread T4753:
    #0 operator new(unsigned long) <null> (proton+0xa0cc967) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #1 void* std::__1::__libcpp_operator_new[abi:v15000]<unsigned long>(unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/new:246:10 (proton+0x1cc10ed8) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/new:272:10 (proton+0x1cc10ed8)
    #3 std::__1::allocator<long>::allocate[abi:v15000](unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (proton+0x1cc10ed8)
    #4 std::__1::allocator<long>::allocate_at_least[abi:v15000](unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator.h:119:17 (proton+0x1cc10ed8)
    #5 std::__1::allocation_result<std::__1::allocator_traits<std::__1::allocator<long>>::pointer> std::__1::allocate_at_least[abi:v15000]<std::__1::allocator<long>>(std::__1::allocator<long>&, unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:33:20 (proton+0x1cc10ed8)
    #6 auto std::__1::__allocate_at_least[abi:v15000]<std::__1::allocator<long>>(std::__1::allocator<long>&, unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocate_at_least.h:42:10 (proton+0x1cc10ed8)
    #7 std::__1::vector<long, std::__1::allocator<long>>::__vallocate[abi:v15000](unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/vector:682:29 (proton+0x1cc10ed8)
    #8 std::__1::vector<long, std::__1::allocator<long>>::vector(unsigned long, long const&) build_tsan/./contrib/llvm-project/libcxx/include/vector:1108:9 (proton+0x1cc10ed8)
    #9 DB::Streaming::ManyAggregatedData::ManyAggregatedData(unsigned long) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.h:91:78 (proton+0x1cc10ed8)
    #10 DB::Streaming::ManyAggregatedData* std::__1::construct_at[abi:v15000]<DB::Streaming::ManyAggregatedData, unsigned long, DB::Streaming::ManyAggregatedData*>(DB::Streaming::ManyAggregatedData*, unsigned long&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35:48 (proton+0x1cc0eeac) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #11 void std::__1::allocator_traits<std::__1::allocator<DB::Streaming::ManyAggregatedData>>::construct[abi:v15000]<DB::Streaming::ManyAggregatedData, unsigned long, void, void>(std::__1::allocator<DB::Streaming::ManyAggregatedData>&, DB::Streaming::ManyAggregatedData*, unsigned long&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298:9 (proton+0x1cc0eeac)
    #12 std::__1::__shared_ptr_emplace<DB::Streaming::ManyAggregatedData, std::__1::allocator<DB::Streaming::ManyAggregatedData>>::__shared_ptr_emplace[abi:v15000]<unsigned long>(std::__1::allocator<DB::Streaming::ManyAggregatedData>, unsigned long&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:292:9 (proton+0x1cc0eeac)
    #13 std::__1::shared_ptr<DB::Streaming::ManyAggregatedData> std::__1::allocate_shared[abi:v15000]<DB::Streaming::ManyAggregatedData, std::__1::allocator<DB::Streaming::ManyAggregatedData>, unsigned long, void>(std::__1::allocator<DB::Streaming::ManyAggregatedData> const&, unsigned long&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:953:55 (proton+0x1cc0eeac)
    #14 std::__1::shared_ptr<DB::Streaming::ManyAggregatedData> std::__1::make_shared[abi:v15000]<DB::Streaming::ManyAggregatedData, unsigned long, void>(unsigned long&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962:12 (proton+0x1cc0eeac)
    #15 DB::Streaming::AggregatingStep::transformPipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) build_tsan/./src/Processors/QueryPlan/Streaming/AggregatingStep.cpp:83:26 (proton+0x1cc0eeac)
    #16 DB::ITransformingStep::updatePipeline(std::__1::vector<std::__1::unique_ptr<DB::QueryPipelineBuilder, std::__1::default_delete<DB::QueryPipelineBuilder>>, std::__1::allocator<std::__1::unique_ptr<DB::QueryPipelineBuilder, std::__1::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) build_tsan/./src/Processors/QueryPlan/ITransformingStep.cpp:52:9 (proton+0x1d7a308f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #17 DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&, std::__1::shared_ptr<DB::Context const>) build_tsan/./src/Processors/QueryPlan/QueryPlan.cpp:185:47 (proton+0x1d7cab8c) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #18 DB::InterpreterSelectWithUnionQuery::execute() build_tsan/./src/Interpreters/InterpreterSelectWithUnionQuery.cpp:398:31 (proton+0x1b0d7018) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #19 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_tsan/./src/Interpreters/executeQuery.cpp:797:36 (proton+0x1b4c7c68) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #20 DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) build_tsan/./src/Interpreters/executeQuery.cpp:1158:30 (proton+0x1b4c3db1) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #21 DB::TCPHandler::runImpl() build_tsan/./src/Server/TCPHandler.cpp:351:24 (proton+0x1c18dfe5) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #22 DB::TCPHandler::run() build_tsan/./src/Server/TCPHandler.cpp:1828:9 (proton+0x1c1a1027) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #23 Poco::Net::TCPServerConnection::start() build_tsan/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (proton+0x2458ccc2) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #24 Poco::Net::TCPServerDispatcher::run() build_tsan/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (proton+0x2458d533) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #25 Poco::PooledThread::run() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:199:14 (proton+0x2488a026) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #26 Poco::(anonymous namespace)::RunnableHolder::run() build_tsan/./base/poco/Foundation/src/Thread.cpp:55:11 (proton+0x2488838f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #27 Poco::ThreadImpl::runnableEntry(void*) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:345:27 (proton+0x248869e7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)

  Mutex M0 (0x7b4801450ba0) created at:
    #0 pthread_mutex_trylock <null> (proton+0xa0472ab) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #1 std::__1::__libcpp_mutex_trylock[abi:v15000](pthread_mutex_t*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:309:10 (proton+0x24dca659) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #2 std::__1::mutex::try_lock() build_tsan/./contrib/llvm-project/libcxx/src/mutex.cpp:46:12 (proton+0x24dca659)
    #3 std::__1::unique_lock<std::__1::mutex>::unique_lock[abi:v15000](std::__1::mutex&, std::__1::try_to_lock_t) build_tsan/./contrib/llvm-project/libcxx/include/__mutex_base:128:52 (proton+0x1d250a85) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #4 DB::Streaming::AggregatingTransform::finalizeAlignment(COW<DB::ChunkContext>::immutable_ptr<DB::ChunkContext> const&) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:310:34 (proton+0x1d250a85)
    #5 DB::Streaming::AggregatingTransform::consume(DB::Chunk) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:163:9 (proton+0x1d2504d7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #6 DB::Streaming::AggregatingTransform::work() build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:130:9 (proton+0x1d250159) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #7 DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:46:26 (proton+0x1c22c037) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #8 DB::ExecutionThreadContext::executeTask() build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:84:9 (proton+0x1c22c037)
    #9 DB::PipelineExecutor::executeStepImpl(unsigned long, std::__1::atomic<bool>*) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:271:26 (proton+0x1c217654) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #10 DB::PipelineExecutor::executeSingleThread(unsigned long) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:236:5 (proton+0x1c219d2a) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #11 DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0::operator()() const build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:373:21 (proton+0x1c219d2a)
    #12 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c219d2a)
    #13 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x1c219d2a)
    #14 decltype(auto) std::__1::apply[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x1c219d2a)
    #15 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:205:13 (proton+0x1c219d2a)
    #16 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c219d2a)
    #17 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1c219d2a)
    #18 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1c219d2a)
    #19 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1c219d2a)
    #20 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120ca695) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #21 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120ca695)
    #22 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:393:13 (proton+0x120ca695)
    #23 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:168:73 (proton+0x120ce911) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #24 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120ce911)
    #25 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120ce911)
    #26 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120ce911)

  Mutex M1 (0x7b4801450b60) created at:
    #0 pthread_mutex_lock <null> (proton+0xa0470db) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (proton+0x24dca5f9) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #2 std::__1::mutex::lock() build_tsan/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (proton+0x24dca5f9)
    #3 std::__1::lock_guard<std::__1::mutex>::lock_guard[abi:v15000](std::__1::mutex&) build_tsan/./contrib/llvm-project/libcxx/include/__mutex_base:94:27 (proton+0x1d250944) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #4 DB::Streaming::AggregatingTransform::updateAndAlignWatermark(long) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:272:21 (proton+0x1d250944)
    #5 DB::Streaming::AggregatingTransform::finalizeAlignment(COW<DB::ChunkContext>::immutable_ptr<DB::ChunkContext> const&) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:295:40 (proton+0x1d250944)
    #6 DB::Streaming::AggregatingTransform::consume(DB::Chunk) build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:163:9 (proton+0x1d2504d7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #7 DB::Streaming::AggregatingTransform::work() build_tsan/./src/Processors/Transforms/Streaming/AggregatingTransform.cpp:130:9 (proton+0x1d250159) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #8 DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:46:26 (proton+0x1c22c037) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #9 DB::ExecutionThreadContext::executeTask() build_tsan/./src/Processors/Executors/ExecutionThreadContext.cpp:84:9 (proton+0x1c22c037)
    #10 DB::PipelineExecutor::executeStepImpl(unsigned long, std::__1::atomic<bool>*) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:271:26 (proton+0x1c217654) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #11 DB::PipelineExecutor::executeSingleThread(unsigned long) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:236:5 (proton+0x1c219d2a) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #12 DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0::operator()() const build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:373:21 (proton+0x1c219d2a)
    #13 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c219d2a)
    #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x1c219d2a)
    #15 decltype(auto) std::__1::apply[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x1c219d2a)
    #16 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:205:13 (proton+0x1c219d2a)
    #17 decltype(std::declval<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c219d2a)
    #18 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1c219d2a)
    #19 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1c219d2a)
    #20 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1c219d2a)
    #21 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120ca695) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #22 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120ca695)
    #23 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:393:13 (proton+0x120ca695)
    #24 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:168:73 (proton+0x120ce911) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #25 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120ce911)
    #26 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120ce911)
    #27 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120ce911)

  Thread T971 'QueryPipelineEx' (tid=738625, running) created by thread T955 at:
    #0 pthread_create <null> (proton+0xa04544b) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (proton+0x120ce2bc) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #2 std::__1::thread::thread<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'(), void>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/thread:311:16 (proton+0x120ce2bc)
    #3 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:168:35 (proton+0x120c89be) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #4 ThreadPoolImpl<std::__1::thread>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:232:5 (proton+0x120c91ce) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #5 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./src/Common/ThreadPool.h:188:38 (proton+0x1c219abe) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #6 ThreadFromGlobalPool* std::__1::construct_at[abi:v15000]<ThreadFromGlobalPool, DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0, ThreadFromGlobalPool*>(ThreadFromGlobalPool*, DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35:48 (proton+0x1c219abe)
    #7 void std::__1::allocator_traits<std::__1::allocator<ThreadFromGlobalPool>>::construct[abi:v15000]<ThreadFromGlobalPool, DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0, void, void>(std::__1::allocator<ThreadFromGlobalPool>&, ThreadFromGlobalPool*, DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298:9 (proton+0x1c219abe)
    #8 void std::__1::vector<ThreadFromGlobalPool, std::__1::allocator<ThreadFromGlobalPool>>::__construct_one_at_end[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/vector:808:5 (proton+0x1c21655c) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #9 ThreadFromGlobalPool& std::__1::vector<ThreadFromGlobalPool, std::__1::allocator<ThreadFromGlobalPool>>::emplace_back<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/vector:1597:9 (proton+0x1c21655c)
    #10 DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:362:21 (proton+0x1c21655c)
    #11 DB::PipelineExecutor::execute(unsigned long, DB::ExecuteMode) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:111:9 (proton+0x1c215f05) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #12 DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::__1::shared_ptr<DB::ThreadGroupStatus>, unsigned long) build_tsan/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:88:24 (proton+0x1c230462) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #13 DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const build_tsan/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:117:13 (proton+0x1c230462)
    #14 decltype(std::declval<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c230462)
    #15 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::__1::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x1c230462)
    #16 decltype(auto) std::__1::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::__1::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x1c230462)
    #17 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:205:13 (proton+0x1c230462)
    #18 decltype(std::declval<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c230462)
    #19 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1c230462)
    #20 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1c230462)
    #21 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1c230462)
    #22 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120ca695) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #23 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120ca695)
    #24 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:393:13 (proton+0x120ca695)
    #25 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:168:73 (proton+0x120ce911) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #26 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120ce911)
    #27 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120ce911)
    #28 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120ce911)

  Thread T307 'QueryPipelineEx' (tid=712699, running) created by main thread at:
    #0 pthread_create <null> (proton+0xa04544b) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (proton+0x120ce2bc) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #2 std::__1::thread::thread<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'(), void>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/thread:311:16 (proton+0x120ce2bc)
    #3 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:168:35 (proton+0x120c89be) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #4 ThreadPoolImpl<std::__1::thread>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:232:5 (proton+0x120d15dc) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #5 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./src/Common/ThreadPool.h:188:38 (proton+0x120d15dc)
    #6 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:168:35 (proton+0x120cb386) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #7 ThreadPoolImpl<ThreadFromGlobalPool>::scheduleOrThrowOnError(std::__1::function<void ()>, long) build_tsan/./src/Common/ThreadPool.cpp:220:5 (proton+0x120cafe4) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #8 DB::DatabaseOrdinary::startupTables(ThreadPoolImpl<ThreadFromGlobalPool>&, bool, bool) build_tsan/./src/Databases/DatabaseOrdinary.cpp:284:25 (proton+0x1a847205) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #9 DB::DatabaseAtomic::startupTables(ThreadPoolImpl<ThreadFromGlobalPool>&, bool, bool) build_tsan/./src/Databases/DatabaseAtomic.cpp:440:23 (proton+0x1a83aa54) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #10 DB::startupSystemTables() build_tsan/./src/Interpreters/loadMetadata.cpp:220:54 (proton+0x1b5ac888) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #11 DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>> const&) build_tsan/./programs/server/Server.cpp:1495:9 (proton+0x120a02ab) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #12 Poco::Util::Application::run() build_tsan/./base/poco/Util/src/Application.cpp:334:8 (proton+0x245ff1fe) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #13 DB::Server::run() build_tsan/./programs/server/Server.cpp:504:25 (proton+0x12090ff0) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #14 Poco::Util::ServerApplication::run(int, char**) build_tsan/./base/poco/Util/src/ServerApplication.cpp:611:9 (proton+0x2461d32e) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #15 mainServer(int, char**) build_tsan/./programs/server/Server.cpp:204:20 (proton+0x1208e576) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #16 main build_tsan/./programs/main.cpp:369:12 (proton+0xa0ce396) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)

  Thread T4753 'TCPHandler' (tid=800874, running) created by thread T318 at:
    #0 pthread_create <null> (proton+0xa04544b) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr<Poco::Runnable, Poco::ReferenceCounter, Poco::ReleasePolicy<Poco::Runnable>>) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:202:6 (proton+0x248863fd) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #2 Poco::Thread::start(Poco::Runnable&) build_tsan/./base/poco/Foundation/src/Thread.cpp:128:2 (proton+0x24887e0c) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #3 Poco::PooledThread::start() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:85:10 (proton+0x2488bfab) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #4 Poco::ThreadPool::getThread() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:461:14 (proton+0x2488bfab)
    #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:365:2 (proton+0x2488c3a7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_tsan/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (proton+0x2458da29) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #7 Poco::Net::TCPServer::run() build_tsan/./base/poco/Net/src/TCPServer.cpp:148:21 (proton+0x2458c5b7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #8 Poco::(anonymous namespace)::RunnableHolder::run() build_tsan/./base/poco/Foundation/src/Thread.cpp:55:11 (proton+0x2488838f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)
    #9 Poco::ThreadImpl::runnableEntry(void*) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:345:27 (proton+0x248869e7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2)

SUMMARY: ThreadSanitizer: data race build_tsan/./src/Processors/Transforms/Streaming/GlobalAggregatingTransform.cpp:95:73 in auto DB::Streaming::GlobalAggregatingTransform::prepareFinalization(long)::$_1::operator()<long>(long&) const
==================

================== WARNING: ThreadSanitizer: data race (pid=712381) Read of size 1 at 0x7b4c003df4b9 by thread T356: #0 nlog::Log::fetch(long, unsigned long, long, std::__1::optional<unsigned long>, nlog::FetchIsolation) build_tsan/./src/NativeLog/Log/Log.cpp:326:9 (proton+0x2051b20f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #1 nlog::NativeLog::fetch(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, nlog::FetchRequest const&) build_tsan/./src/NativeLog/Server/NativeLog.cpp:364:64 (proton+0x204b59d3) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #2 DB::StreamingBlockReaderNativeLog::read() build_tsan/./src/Storages/Streaming/StreamingBlockReaderNativeLog.cpp:78:26 (proton+0x1cbede65) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #3 DB::StreamShard::backgroundPollNativeLog() build_tsan/./src/Storages/Streaming/StreamShard.cpp:247:39 (proton+0x1cbcaa7a) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #4 DB::StreamShard::startup()::$_1::operator()() const build_tsan/./src/Storages/Streaming/StreamShard.cpp:164:53 (proton+0x1cbd5c21) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #5 decltype(std::declval<DB::StreamShard::startup()::$_1&>()()) std::__1::__invoke[abi:v15000]<DB::StreamShard::startup()::$_1&>(DB::StreamShard::startup()::$_1&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1cbd5c21) #6 void std::__1::__invoke_void_return_wrapper<void, true>::__call<DB::StreamShard::startup()::$_1&>(DB::StreamShard::startup()::$_1&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1cbd5c21) #7 std::__1::__function::__default_alloc_func<DB::StreamShard::startup()::$_1, void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1cbd5c21) #8 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<DB::StreamShard::startup()::$_1, void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1cbd5c21) #9 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120cd701) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #10 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120cd701) #11 ThreadPoolImpl<ThreadFromGlobalPool>::worker(std::__1::__list_iterator<ThreadFromGlobalPool, void*>) build_tsan/./src/Common/ThreadPool.cpp:393:13 (proton+0x120cd701) #12 void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:168:73 (proton+0x120d1d2c) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #13 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120d1d2c) #14 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x120d1d2c) #15 decltype(auto) std::__1::apply[abi:v15000]<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()&, std::__1::tuple<>&>(void&&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x120d1d2c) #16 ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:205:13 (proton+0x120d1d2c) #17 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120d1d2c) #18 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x120d1ca1) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #19 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x120d1ca1) #20 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<void ThreadPoolImpl<ThreadFromGlobalPool>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x120d1ca1) #21 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120ca695) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #22 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120ca695) #23 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:393:13 (proton+0x120ca695) #24 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:168:73 (proton+0x120ce911) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #25 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120ce911) #26 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120ce911) #27 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120ce911) Previous write of size 1 at 0x7b4c003df4b9 by thread T765 (mutexes: write M0): #0 nlog::Log::setInmemory(bool) build_tsan/./src/NativeLog/Log/Log.h:130:49 (proton+0x204b7275) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #1 nlog::NativeLog::setInmemory(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag> const&, int, bool) build_tsan/./src/NativeLog/Server/NativeLog.cpp:408:14 (proton+0x204b7275) #2 DB::StreamShard::initNativeLog() build_tsan/./src/Storages/Streaming/StreamShard.cpp:944:24 (proton+0x1cbd187b) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #3 DB::StreamShard::initLog() build_tsan/./src/Storages/Streaming/StreamShard.cpp:827:9 (proton+0x1cbc86d6) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #4 DB::StreamShard::startup() build_tsan/./src/Storages/Streaming/StreamShard.cpp:129:5 (proton+0x1cbc7574) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #5 DB::StorageStream::startup() build_tsan/./src/Storages/Streaming/StorageStream.cpp:934:23 (proton+0x1cba6d1f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #6 DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&) build_tsan/./src/Interpreters/InterpreterCreateQuery.cpp:1242:14 (proton+0x1b091d04) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #7 DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) build_tsan/./src/Interpreters/InterpreterCreateQuery.cpp:1043:20 (proton+0x1b08bf62) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #8 DB::InterpreterCreateQuery::execute() build_tsan/./src/Interpreters/InterpreterCreateQuery.cpp:1457:16 (proton+0x1b0946b0) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #9 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_tsan/./src/Interpreters/executeQuery.cpp:797:36 (proton+0x1b4c7c68) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #10 DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) build_tsan/./src/Interpreters/executeQuery.cpp:1158:30 (proton+0x1b4c3db1) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #11 DB::TCPHandler::runImpl() build_tsan/./src/Server/TCPHandler.cpp:351:24 (proton+0x1c18dfe5) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #12 DB::TCPHandler::run() build_tsan/./src/Server/TCPHandler.cpp:1828:9 (proton+0x1c1a1027) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #13 Poco::Net::TCPServerConnection::start() build_tsan/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (proton+0x2458ccc2) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #14 Poco::Net::TCPServerDispatcher::run() build_tsan/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (proton+0x2458d533) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #15 Poco::PooledThread::run() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:199:14 (proton+0x2488a026) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #16 Poco::(anonymous namespace)::RunnableHolder::run() build_tsan/./base/poco/Foundation/src/Thread.cpp:55:11 (proton+0x2488838f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #17 Poco::ThreadImpl::runnableEntry(void*) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:345:27 (proton+0x248869e7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) Location is heap block of size 408 at 0x7b4c003df440 allocated by thread T765: #0 operator new(unsigned long) <null> (proton+0xa0cc967) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #1 void* std::__1::__libcpp_operator_new[abi:v15000]<unsigned long>(unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/new:246:10 (proton+0x2051969f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #2 std::__1::__libcpp_allocate[abi:v15000](unsigned long, unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/new:272:10 (proton+0x2051969f) #3 std::__1::allocator<std::__1::__shared_ptr_emplace<nlog::Log, std::__1::allocator<nlog::Log>>>::allocate[abi:v15000](unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator.h:112:38 (proton+0x2051969f) #4 std::__1::allocator_traits<std::__1::allocator<std::__1::__shared_ptr_emplace<nlog::Log, std::__1::allocator<nlog::Log>>>>::allocate[abi:v15000](std::__1::allocator<std::__1::__shared_ptr_emplace<nlog::Log, std::__1::allocator<nlog::Log>>>&, unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:262:20 (proton+0x2051969f) #5 std::__1::__allocation_guard<std::__1::allocator<std::__1::__shared_ptr_emplace<nlog::Log, std::__1::allocator<nlog::Log>>>>::__allocation_guard[abi:v15000]<std::__1::allocator<nlog::Log>>(std::__1::allocator<nlog::Log>, unsigned long) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocation_guard.h:53:18 (proton+0x2051969f) #6 std::__1::shared_ptr<nlog::Log> std::__1::allocate_shared[abi:v15000]<nlog::Log, std::__1::allocator<nlog::Log>, long&, std::__1::shared_ptr<nlog::Loglet>, std::__1::shared_ptr<nlog::TailCache>, Poco::Logger*&, void>(std::__1::allocator<nlog::Log> const&, long&, std::__1::shared_ptr<nlog::Loglet>&&, std::__1::shared_ptr<nlog::TailCache>&&, Poco::Logger*&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:952:48 (proton+0x2051969f) #7 std::__1::shared_ptr<nlog::Log> std::__1::make_shared[abi:v15000]<nlog::Log, long&, std::__1::shared_ptr<nlog::Loglet>, std::__1::shared_ptr<nlog::TailCache>, Poco::Logger*&, void>(long&, std::__1::shared_ptr<nlog::Loglet>&&, std::__1::shared_ptr<nlog::TailCache>&&, Poco::Logger*&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:962:12 (proton+0x2051969f) #8 nlog::Log::create(nlog::StreamShard const&, std::__1::__fs::filesystem::path const&, std::__1::shared_ptr<nlog::LogConfig>, bool, long, long, std::__1::shared_ptr<DB::NLOG::BackgroundSchedulePool>, std::__1::shared_ptr<ThreadPoolImpl<ThreadFromGlobalPool>>, std::__1::shared_ptr<nlog::TailCache>) build_tsan/./src/NativeLog/Log/Log.cpp:53:12 (proton+0x2051969f) #9 nlog::LogManager::getOrCreateLog(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, nlog::StreamShard const&, bool, bool) build_tsan/./src/NativeLog/Log/LogManager.cpp:581:11 (proton+0x204cffd3) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #10 nlog::NativeLog::createStream(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, nlog::CreateStreamRequest const&) build_tsan/./src/NativeLog/Server/NativeLog.cpp:270:50 (proton+0x204b437c) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #11 DB::StreamShard::initNativeLog() build_tsan/./src/Storages/Streaming/StreamShard.cpp:930:37 (proton+0x1cbd18c5) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #12 DB::StreamShard::initLog() build_tsan/./src/Storages/Streaming/StreamShard.cpp:827:9 (proton+0x1cbc86d6) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #13 DB::StreamShard::startup() build_tsan/./src/Storages/Streaming/StreamShard.cpp:129:5 (proton+0x1cbc7574) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #14 DB::StorageStream::startup() build_tsan/./src/Storages/Streaming/StorageStream.cpp:934:23 (proton+0x1cba6d1f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #15 DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&) build_tsan/./src/Interpreters/InterpreterCreateQuery.cpp:1242:14 (proton+0x1b091d04) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #16 DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) build_tsan/./src/Interpreters/InterpreterCreateQuery.cpp:1043:20 (proton+0x1b08bf62) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #17 DB::InterpreterCreateQuery::execute() build_tsan/./src/Interpreters/InterpreterCreateQuery.cpp:1457:16 (proton+0x1b0946b0) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #18 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_tsan/./src/Interpreters/executeQuery.cpp:797:36 (proton+0x1b4c7c68) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #19 DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) build_tsan/./src/Interpreters/executeQuery.cpp:1158:30 (proton+0x1b4c3db1) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #20 DB::TCPHandler::runImpl() build_tsan/./src/Server/TCPHandler.cpp:351:24 (proton+0x1c18dfe5) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #21 DB::TCPHandler::run() build_tsan/./src/Server/TCPHandler.cpp:1828:9 (proton+0x1c1a1027) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #22 Poco::Net::TCPServerConnection::start() build_tsan/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (proton+0x2458ccc2) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #23 Poco::Net::TCPServerDispatcher::run() build_tsan/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (proton+0x2458d533) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #24 Poco::PooledThread::run() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:199:14 (proton+0x2488a026) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #25 Poco::(anonymous namespace)::RunnableHolder::run() build_tsan/./base/poco/Foundation/src/Thread.cpp:55:11 (proton+0x2488838f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #26 Poco::ThreadImpl::runnableEntry(void*) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:345:27 (proton+0x248869e7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) Mutex M0 (0x7b0c0022bd20) created at: #0 pthread_mutex_lock <null> (proton+0xa0470db) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #1 std::__1::__libcpp_mutex_lock[abi:v15000](pthread_mutex_t*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:304:10 (proton+0x24dca5f9) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #2 std::__1::mutex::lock() build_tsan/./contrib/llvm-project/libcxx/src/mutex.cpp:38:14 (proton+0x24dca5f9) #3 std::__1::unique_lock<std::__1::mutex>::unique_lock[abi:v15000](std::__1::mutex&) build_tsan/./contrib/llvm-project/libcxx/include/__mutex_base:122:61 (proton+0x1ad5e5c8) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #4 DB::DDLGuard::DDLGuard(std::__1::map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, DB::DDLGuard::Entry, std::__1::less<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const, DB::DDLGuard::Entry>>>&, std::__1::shared_mutex&, std::__1::unique_lock<std::__1::mutex>, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) build_tsan/./src/Interpreters/DatabaseCatalog.cpp:1276:18 (proton+0x1ad5e5c8) #5 std::__1::__unique_if<DB::DDLGuard>::__unique_single std::__1::make_unique[abi:v15000]<DB::DDLGuard, std::__1::map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, DB::DDLGuard::Entry, std::__1::less<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const, DB::DDLGuard::Entry>>>&, std::__1::shared_mutex&, std::__1::unique_lock<std::__1::mutex>, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&>(std::__1::map<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>, DB::DDLGuard::Entry, std::__1::less<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>>, std::__1::allocator<std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const, DB::DDLGuard::Entry>>>&, std::__1::shared_mutex&, std::__1::unique_lock<std::__1::mutex>&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:714:32 (proton+0x1ad54795) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #6 DB::DatabaseCatalog::getDDLGuard(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) build_tsan/./src/Interpreters/DatabaseCatalog.cpp:668:12 (proton+0x1ad54795) #7 DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&) build_tsan/./src/Interpreters/InterpreterCreateQuery.cpp:1079:41 (proton+0x1b08fadb) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #8 DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) build_tsan/./src/Interpreters/InterpreterCreateQuery.cpp:1043:20 (proton+0x1b08bf62) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #9 DB::InterpreterCreateQuery::execute() build_tsan/./src/Interpreters/InterpreterCreateQuery.cpp:1457:16 (proton+0x1b0946b0) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #10 DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) build_tsan/./src/Interpreters/executeQuery.cpp:797:36 (proton+0x1b4c7c68) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #11 DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) build_tsan/./src/Interpreters/executeQuery.cpp:1158:30 (proton+0x1b4c3db1) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #12 DB::TCPHandler::runImpl() build_tsan/./src/Server/TCPHandler.cpp:351:24 (proton+0x1c18dfe5) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #13 DB::TCPHandler::run() build_tsan/./src/Server/TCPHandler.cpp:1828:9 (proton+0x1c1a1027) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #14 Poco::Net::TCPServerConnection::start() build_tsan/./base/poco/Net/src/TCPServerConnection.cpp:43:3 (proton+0x2458ccc2) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #15 Poco::Net::TCPServerDispatcher::run() build_tsan/./base/poco/Net/src/TCPServerDispatcher.cpp:115:20 (proton+0x2458d533) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #16 Poco::PooledThread::run() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:199:14 (proton+0x2488a026) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #17 Poco::(anonymous namespace)::RunnableHolder::run() build_tsan/./base/poco/Foundation/src/Thread.cpp:55:11 (proton+0x2488838f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #18 Poco::ThreadImpl::runnableEntry(void*) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:345:27 (proton+0x248869e7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) Thread T356 'StreamShard' (tid=719108, running) created by thread T314 at: #0 pthread_create <null> (proton+0xa04544b) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #1 std::__1::__libcpp_thread_create[abi:v15000](unsigned long*, void* (*)(void*), void*) build_tsan/./contrib/llvm-project/libcxx/include/__threading_support:376:10 (proton+0x120ce2bc) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #2 std::__1::thread::thread<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'(), void>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/thread:311:16 (proton+0x120ce2bc) #3 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool) build_tsan/./src/Common/ThreadPool.cpp:168:35 (proton+0x120c89be) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #4 ThreadPoolImpl<std::__1::thread>::scheduleOrThrow(std::__1::function<void ()>, long, unsigned long) build_tsan/./src/Common/ThreadPool.cpp:232:5 (proton+0x120c91ce) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #5 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./src/Common/ThreadPool.h:188:38 (proton+0x1c219abe) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #6 ThreadFromGlobalPool* std::__1::construct_at[abi:v15000]<ThreadFromGlobalPool, DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0, ThreadFromGlobalPool*>(ThreadFromGlobalPool*, DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/construct_at.h:35:48 (proton+0x1c219abe) #7 void std::__1::allocator_traits<std::__1::allocator<ThreadFromGlobalPool>>::construct[abi:v15000]<ThreadFromGlobalPool, DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0, void, void>(std::__1::allocator<ThreadFromGlobalPool>&, ThreadFromGlobalPool*, DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:298:9 (proton+0x1c219abe) #8 void std::__1::vector<ThreadFromGlobalPool, std::__1::allocator<ThreadFromGlobalPool>>::__construct_one_at_end[abi:v15000]<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/vector:808:5 (proton+0x1c21655c) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #9 ThreadFromGlobalPool& std::__1::vector<ThreadFromGlobalPool, std::__1::allocator<ThreadFromGlobalPool>>::emplace_back<DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0>(DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/vector:1597:9 (proton+0x1c21655c) #10 DB::PipelineExecutor::executeImpl(unsigned long, DB::ExecuteMode) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:362:21 (proton+0x1c21655c) #11 DB::PipelineExecutor::execute(unsigned long, DB::ExecuteMode) build_tsan/./src/Processors/Executors/PipelineExecutor.cpp:111:9 (proton+0x1c215f05) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #12 DB::threadFunction(DB::PullingAsyncPipelineExecutor::Data&, std::__1::shared_ptr<DB::ThreadGroupStatus>, unsigned long) build_tsan/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:88:24 (proton+0x1c230462) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #13 DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0::operator()() const build_tsan/./src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:117:13 (proton+0x1c230462) #14 decltype(std::declval<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&>()()) std::__1::__invoke[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c230462) #15 decltype(auto) std::__1::__apply_tuple_impl[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::__1::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::__1::tuple<>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1789:1 (proton+0x1c230462) #16 decltype(auto) std::__1::apply[abi:v15000]<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::__1::tuple<>&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&, std::__1::tuple<>&) build_tsan/./contrib/llvm-project/libcxx/include/tuple:1798:1 (proton+0x1c230462) #17 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()::operator()() build_tsan/./src/Common/ThreadPool.h:205:13 (proton+0x1c230462) #18 decltype(std::declval<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>()()) std::__1::__invoke[abi:v15000]<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x1c230462) #19 void std::__1::__invoke_void_return_wrapper<void, true>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&>(ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'()&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:479:9 (proton+0x1c230462) #20 std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>::operator()[abi:v15000]() build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:235:12 (proton+0x1c230462) #21 void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0>(DB::PullingAsyncPipelineExecutor::pull(DB::Chunk&, unsigned long)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*) build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:716:16 (proton+0x1c230462) #22 std::__1::__function::__policy_func<void ()>::operator()[abi:v15000]() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:848:16 (proton+0x120ca695) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #23 std::__1::function<void ()>::operator()() const build_tsan/./contrib/llvm-project/libcxx/include/__functional/function.h:1187:12 (proton+0x120ca695) #24 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) build_tsan/./src/Common/ThreadPool.cpp:393:13 (proton+0x120ca695) #25 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()::operator()() const build_tsan/./src/Common/ThreadPool.cpp:168:73 (proton+0x120ce911) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #26 decltype(std::declval<void>()()) std::__1::__invoke[abi:v15000]<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(void&&) build_tsan/./contrib/llvm-project/libcxx/include/__functional/invoke.h:394:23 (proton+0x120ce911) #27 void std::__1::__thread_execute[abi:v15000]<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>&, std::__1::__tuple_indices<>) build_tsan/./contrib/llvm-project/libcxx/include/thread:284:5 (proton+0x120ce911) #28 void* std::__1::__thread_proxy[abi:v15000]<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct>>, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, long, std::__1::optional<unsigned long>, bool)::'lambda0'()>>(void*) build_tsan/./contrib/llvm-project/libcxx/include/thread:295:5 (proton+0x120ce911) Thread T765 'TCPHandler' (tid=734279, running) created by thread T318 at: #0 pthread_create <null> (proton+0xa04544b) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #1 Poco::ThreadImpl::startImpl(Poco::SharedPtr<Poco::Runnable, Poco::ReferenceCounter, Poco::ReleasePolicy<Poco::Runnable>>) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:202:6 (proton+0x248863fd) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #2 Poco::Thread::start(Poco::Runnable&) build_tsan/./base/poco/Foundation/src/Thread.cpp:128:2 (proton+0x24887e0c) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #3 Poco::PooledThread::start() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:85:10 (proton+0x2488bfab) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #4 Poco::ThreadPool::getThread() build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:461:14 (proton+0x2488bfab) #5 Poco::ThreadPool::startWithPriority(Poco::Thread::Priority, Poco::Runnable&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) build_tsan/./base/poco/Foundation/src/ThreadPool.cpp:365:2 (proton+0x2488c3a7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #6 Poco::Net::TCPServerDispatcher::enqueue(Poco::Net::StreamSocket const&) build_tsan/./base/poco/Net/src/TCPServerDispatcher.cpp:152:17 (proton+0x2458da29) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #7 Poco::Net::TCPServer::run() build_tsan/./base/poco/Net/src/TCPServer.cpp:148:21 (proton+0x2458c5b7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #8 Poco::(anonymous namespace)::RunnableHolder::run() build_tsan/./base/poco/Foundation/src/Thread.cpp:55:11 (proton+0x2488838f) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) #9 Poco::ThreadImpl::runnableEntry(void*) build_tsan/./base/poco/Foundation/src/Thread_POSIX.cpp:345:27 (proton+0x248869e7) (BuildId: 7983c79161693d4393f040cd758e2a46fbb4aeb2) SUMMARY: ThreadSanitizer: data race build_tsan/./src/NativeLog/Log/Log.cpp:326:9 in nlog::Log::fetch(long, unsigned long, long, std::__1::optional<unsigned long>, nlog::FetchIsolation) ==================

timeplus-io / proton

fix tsan(thread sanitizer) (fail in startup proton server) #320

disk utils