apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.6k stars 3.25k forks source link

[Bug] doris1.2.4.1upgrade1.2.6 Segmentation fault 错误 #22816

Open yuanchanggang opened 1 year ago

yuanchanggang commented 1 year ago

Search before asking

Version

doris 1.2.4.1 os:centos7.9 x64 jdk:11.0.14 node :3be + 3fe

What's Wrong?

[root@iZwz9eo5hrxzgj3hm885asZ doris-be]# bin/start_be.sh SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/data/doris/doris-be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/data/doris/doris-be/lib/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory] I0810 14:57:28.462283 3068 daemon.cpp:432] version doris-1.2.6-rc03(AVX2) RELEASE (build file://VM-10-6-centos@Unknown) Built on Thu, 13 Jul 2023 14:45:18 UTC by VM-10-6-centos I0810 14:57:28.463495 3068 mem_info.cpp:302] Physical Memory: 61.76 GB, Mem Limit: 49.41 GB, origin config value: 80%, System Mem Available Min Reserve: 1.60 GB, Vm Min Free KBytes: 66.00 MB I0810 14:57:28.464975 3068 daemon.cpp:465] Cpu Info: Model: Intel(R) Xeon(R) Platinum 8369B CPU @ 2.70GHz Cores: 8 Max Possible Cores: 8 L1 Cache: 48.00 KB (Line: 64.00 B) L2 Cache: 1.25 MB (Line: 64.00 B) L3 Cache: 48.00 MB (Line: 64.00 B) Hardware Supports: ssse3 sse4_1 sse4_2 popcnt avx avx2 Numa Nodes: 1 Numa Nodes of Cores: 0->0 | 1->0 | 2->0 | 3->0 | 4->0 | 5->0 | 6->0 | 7->0 | I0810 14:57:28.465071 3068 daemon.cpp:466] Disk Info: Num disks 2: vda, vdb I0810 14:57:28.465080 3068 daemon.cpp:467] Physical Memory: 61.76 GB Memory Limt: 49.41 GB CGroup Info: Process CGroup Info: memory.limit_in_bytes=9223372036854771712, cpu cfs limits: unlimited I0810 14:57:28.466388 3068 backend_options.cpp:88] priority cidrs in conf: 192.168.0.0/24 I0810 14:57:28.466456 3068 backend_options.cpp:76] local host ip=192.168.0.12 I0810 14:57:28.470665 3068 exec_env_init.cpp:108] scan thread pool use PriorityWorkStealingThreadPool I0810 14:57:28.481652 3416 fragment_mgr.cpp:850] FragmentMgr cancel worker start working. I0810 14:57:28.513559 3068 load_path_mgr.cpp:59] Load path configured to [/data/doris/doris-be/doris-be-date/mini_download] I0810 14:57:28.513563 3493 result_buffer_mgr.cpp:149] result buffer manager cancel thread begin. I0810 14:57:28.518159 3068 exec_env_init.cpp:242] Buffer pool memory limit: 9.88 GB, origin config value: 20%. clean pages limit: 4.94 GB, origin config value: 50% I0810 14:57:28.518208 3068 exec_env_init.cpp:259] Storage page cache memory limit: 9.88 GB, origin config value: 20% I0810 14:57:28.518213 3068 exec_env_init.cpp:275] segment_cache_capacity = fd_number / 3 * 2, fd_number: 65536 segment_cache_capacity: 43690 I0810 14:57:28.518383 3068 tmp_file_mgr.cc:113] Using scratch directory /data/doris/doris-be/doris-be-date/doris-scratch on disk 1 I0810 14:57:28.518399 3068 exec_env_init.cpp:296] Chunk allocator memory limit: 0, origin config value: 0 I0810 14:57:28.518750 3068 storage_engine.cpp:97] starting backend using uid:4048dc2e6f8417a7-12e5e2b4ca2c9194 I0810 14:57:28.518852 3647 data_dir.cpp:745] path: /data/doris/doris-be/doris-be-date total capacity: 739688570880, available capacity: 289289785344 I0810 14:57:28.518909 3647 data_dir.cpp:192] path: /data/doris/doris-be/doris-be-date, hash: 15642296719644422594 Query id: 0-0 Aborted at 1691650648 (unix time) try "date -d @1691650648" if you are using GNU date Current BE git commitID: Unknown SIGSEGV address not mapped to object (@0x0) received by PID 3068 (TID 0x7fd42bfe0700) from PID 0; stack trace: I0810 14:57:28.567337 3105 daemon.cpp:233] OS physical memory 61.76 GB. Process memory usage 406.12 MB, limit 49.41 GB, soft limit 44.47 GB. Sys available memory 59.99 GB, low water mark 1.60 GB, warning water mark 3.20 GB. Refresh interval memory growth 0 B I0810 14:57:28.868630 3105 daemon.cpp:233] OS physical memory 61.76 GB. Process memory usage 523.42 MB, limit 49.41 GB, soft limit 44.47 GB. Sys available memory 59.90 GB, low water mark 1.60 GB, warning water mark 3.20 GB. Refresh interval memory growth 0 B 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t, void) at /root/doris/be/src/common/signal_handler.h:420 1# os::Linux::chained_handler(int, siginfo, void) in /opt/jdk-11.0.14/lib/server/libjvm.so 2# JVM_handle_linux_signal in /opt/jdk-11.0.14/lib/server/libjvm.so 3# signalHandler(int, siginfo, void) in /opt/jdk-11.0.14/lib/server/libjvm.so 4# 0x00007FD5E217A400 in /lib64/libc.so.6 5# je_arena_dalloc_promoted at ../src/arena.c:1604 6# GIdl_deallocate_tls in /lib64/ld-linux-x86-64.so.2 7# free_stacks in /lib64/libpthread.so.0 8# __deallocate_stack in /lib64/libpthread.so.0 9# pthread_join in /lib64/libpthread.so.0 10# std::thread::join() at ../../../../../libstdc++-v3/src/c++11/thread.cc:114 11# rocksdb::VersionBuilder::Rep::LoadTableHandlers(rocksdb::InternalStats*, int, bool) in /data/doris/doris-be//lib/doris_be 12# rocksdb::VersionSet::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator > const&, bool) in /data/doris/doris-be//lib/doris_be 13# rocksdb::DBImpl::Recover(std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator > const&, bool, bool, bool) in /data/doris/doris-be//lib/doris_be 14# rocksdb::DBImpl::Open(rocksdb::DBOptions const&, std::cxx11::basic_string<char, std::char_traits, std::allocator > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator > const&, std::vector<rocksdb::ColumnFamilyHandle, std::allocator<rocksdb::ColumnFamilyHandle> >*, rocksdb::DB*, bool) in /data/doris/doris-be//lib/doris_be 15# rocksdb::DB::Open(rocksdb::DBOptions const&, std::__cxx11::basic_string<char, std::char_traits, std::allocator > const&, std::vector<rocksdb::ColumnFamilyDescriptor, std::allocator > const&, std::vector<rocksdb::ColumnFamilyHandle, std::allocator<rocksdb::ColumnFamilyHandle> >, rocksdb::DB**) in /data/doris/doris-be//lib/doris_be 16# doris::OlapMeta::init() at /root/doris/be/src/olap/olap_meta.cpp:79 17# doris::DataDir::_init_meta() at /root/doris/be/src/olap/data_dir.cpp:202 18# doris::DataDir::init() at /root/doris/be/src/olap/data_dir.cpp:115 19# std::thread::_State_impl<std::thread::_Invoker<std::tuple<doris::StorageEngine::_init_store_map()::{lambda()#1}> > >::_M_run() at /var/local/ldb-toolchain/include/c++/11/bits/std_thread.h:211 20# execute_native_thread_routine at ../../../../../libstdc++-v3/src/c++11/thread.cc:84 21# start_thread in /lib64/libpthread.so.0 22# clone in /lib64/libc.so.6

bin/start_be.sh: line 321: 3068 Segmentation fault ${LIMIT:+${LIMIT}} "${DORIS_HOME}/lib/doris_be" "$@" 2>&1 < /dev/null

What You Expected?

帮看看是什么原因

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

Code of Conduct

vinlee19 commented 1 year ago

Please change your java version to jdk 1.8

Zhang21 commented 9 months ago

Please change your java version to jdk 1.8

Yes.