apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.78k stars 3.29k forks source link

大单表where等于条件一查询 be就崩溃 #15492

Open huzef opened 1 year ago

huzef commented 1 year ago

Aborted at 1672311182 (unix time) try "date -d @1672311182" if you are using GNU date Current BE git commitID: Unknown SIGSEGV unkown detail explain (@0x0) received by PID 33970 (TID 0x7fa3591ff700) from PID 0; stack trace: 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t, void) at /root/doris/be/src/common/signal_handler.h:420 1# os::Linux::chained_handler(int, siginfo_t, void) in /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-2.el8_5.x86_64/jre/lib/amd64/server/libjvm.so 2# JVM_handle_linux_signal in /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-2.el8_5.x86_64/jre/lib/amd64/server/libjvm.so 3# signalHandler(int, siginfo_t, void) in /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.312.b07-2.el8_5.x86_64/jre/lib/amd64/server/libjvm.so 4# 0x00007FA3C0041790 in /lib64/libc.so.6 5# doris::vectorized::VUnionIterator::next_batch(doris::vectorized::Block) at /root/doris/be/src/vec/olap/vgeneric_iterators.cpp:384 6# doris::BetaRowsetReader::next_block(doris::vectorized::Block) at /root/doris/be/src/olap/rowset/beta_rowset_reader.cpp:278 7# doris::vectorized::VCollectIterator::Level0Iterator::next(doris::vectorized::Block) at /root/doris/be/src/vec/olap/vcollect_iterator.cpp:268 8# doris::vectorized::VCollectIterator::Level1Iterator::_normal_next(doris::vectorized::Block) at /root/doris/be/src/vec/olap/vcollect_iterator.cpp:534 9# doris::vectorized::VCollectIterator::Level1Iterator::_normal_next(doris::vectorized::Block) at /root/doris/be/src/vec/olap/vcollect_iterator.cpp:542 10# doris::vectorized::VCollectIterator::Level1Iterator::next(doris::vectorized::Block) at /root/doris/be/src/vec/olap/vcollect_iterator.cpp:361 11# doris::vectorized::VCollectIterator::next(doris::vectorized::Block) at /root/doris/be/src/vec/olap/vcollect_iterator.cpp:191 12# doris::vectorized::BlockReader::_direct_next_block(doris::vectorized::Block, doris::MemPool, doris::ObjectPool, bool) at /root/doris/be/src/vec/olap/block_reader.cpp:168 13# doris::vectorized::BlockReader::next_block_with_aggregation(doris::vectorized::Block, doris::MemPool, doris::ObjectPool, bool) at /root/doris/be/src/vec/olap/block_reader.h:46 14# doris::vectorized::NewOlapScanner::_get_block_impl(doris::RuntimeState, doris::vectorized::Block, bool) at /root/doris/be/src/vec/exec/scan/new_olap_scanner.cpp:318 15# doris::vectorized::VScanner::get_block(doris::RuntimeState, doris::vectorized::Block, bool) at /root/doris/be/src/vec/exec/scan/vscanner.cpp:53 16# doris::vectorized::ScannerScheduler::_scanner_scan(doris::vectorized::ScannerScheduler, doris::vectorized::ScannerContext, doris::vectorized::VScanner) at /root/doris/be/src/vec/exec/scan/scanner_sched uler.cpp:236 17# doris::ThreadPool::dispatch_thread() at /root/doris/be/src/util/threadpool.cpp:542 18# doris::Thread::supervise_thread(void*) at /root/doris/be/src/util/thread.cpp:455 19# start_thread in /lib64/libpthread.so.0 20# __GI___clone in /lib64/libc.so.6

BiteTheDDDDt commented 1 year ago

doris的版本是什么?是否有可以用于复现崩溃的相关查询/建表语句

a1558122276 commented 1 year ago

我也遇到了这个问题 doris版本2.0 只有查询大单表的时候会有这个问题 目前单表容量280G+ Query id: 196de2ba47c5409b-bfa11bfd55e80576 Aborted at 1698651160 (unix time) try "date -d @1698651160" if you are using GNU date Current BE git commitID: 96bb9a7 SIGSEGV address not mapped to object (@0x10) received by PID 59905 (TID 60409 OR 0x7f5d92d7c700) from PID 16; stack trace: ** 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t, void) at /root/src/doris/be/src/common/signal_handler.h:413 1# os::Linux::chained_handler(int, siginfo, void) in /opt/java/jdk1.8.0_371/jre/lib/amd64/server/libjvm.so 2# JVM_handle_linux_signal in /opt/java/jdk1.8.0_371/jre/lib/amd64/server/libjvm.so 3# signalHandler(int, siginfo, void) in /opt/java/jdk1.8.0_371/jre/lib/amd64/server/libjvm.so 4# 0x00007F5EB8BF3400 in /lib64/libc.so.6 5# doris::vectorized::ColumnVector::insert_res_column(unsigned short const, unsigned long, doris::vectorized::ColumnVector) at /root/src/doris/be/src/vec/columns/column_vector.h:160 6# doris::vectorized::ColumnNullable::filter_by_selector(unsigned short const, unsigned long, doris::vectorized::IColumn) at /root/src/doris/be/src/vec/columns/column_nullable.cpp:367 7# doris::vectorized::Block::copy_column_data_to_block(doris::vectorized::IColumn, unsigned short, unsigned short, int, unsigned long) at /root/src/doris/be/src/vec/core/block.h:161 8# doris::Status doris::segment_v2::SegmentIterator::_output_column_by_sel_idx<std::vector<unsigned int, std::allocator > >(doris::vectorized::Block, std::vector<unsigned int, std::allocator > const&, unsigned short, unsigned short) at /root/src/doris/be/src/olap/rowset/segment_v2/segment_iterator.h:233 9# doris::segment_v2::SegmentIterator::_next_batch_internal(doris::vectorized::Block) in /home/downloadfile/doris-be/lib/doris_be 10# doris::segment_v2::SegmentIterator::next_batch(doris::vectorized::Block) at /root/src/doris/be/src/olap/rowset/segment_v2/segment_iterator.cpp:1740 11# doris::BetaRowsetReader::next_block(doris::vectorized::Block) at /root/src/doris/be/src/olap/rowset/beta_rowset_reader.cpp:288 12# doris::vectorized::VCollectIterator::_topn_next(doris::vectorized::Block) at /root/src/doris/be/src/vec/olap/vcollect_iterator.cpp:301 13# doris::vectorized::VCollectIterator::next(doris::vectorized::Block) in /home/downloadfile/doris-be/lib/doris_be 14# doris::vectorized::BlockReader::_direct_next_block(doris::vectorized::Block, bool) at /root/src/doris/be/src/vec/olap/block_reader.cpp:254 15# doris::vectorized::BlockReader::next_block_with_aggregation(doris::vectorized::Block, bool) at /root/src/doris/be/src/vec/olap/block_reader.h:51 16# doris::vectorized::NewOlapScanner::_get_block_impl(doris::RuntimeState, doris::vectorized::Block, bool) at /root/src/doris/be/src/vec/exec/scan/new_olap_scanner.cpp:470 17# doris::vectorized::VScanner::get_block(doris::RuntimeState, doris::vectorized::Block, bool) in /home/downloadfile/doris-be/lib/doris_be 18# doris::vectorized::ScannerScheduler::_scanner_scan(doris::vectorized::ScannerScheduler, doris::vectorized::ScannerContext, std::shared_ptr) at /root/src/doris/be/src/vec/exec/scan/scanner_scheduler.cpp:339 19# std::_Function_handler<void (), doris::vectorized::ScannerScheduler::_schedule_scanners(doris::vectorized::ScannerContext*)::$_1::operator()() const::{lambda()#2}>::_M_invoke(std::_Any_data const&) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291 20# doris::PriorityWorkStealingThreadPool::work_thread(int) at /root/src/doris/be/src/util/priority_work_stealing_thread_pool.hpp:137 21# execute_native_thread_routine at ../../../../../libstdc++-v3/src/c++11/thread.cc:84 22# start_thread in /lib64/libpthread.so.0 23# clone in /lib64/libc.so.6