kanghuzai
commented
8 months ago This is my first time starting BE and reporting this error
start time: Wed Jan 24 16:20:03 CST 2024
INFO: java_cmd /usr/java/jdk1.8.0_192/bin/java
INFO: jdk_version 8
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/apache-doris-2.0.3-bin-x64-noavx2/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLogger
Binder.class]
SLF4J: Found binding in [jar:file:/usr/local/apache-doris-2.0.3-bin-x64-noavx2/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/apache-doris-2.0.3-bin-x64-noavx2/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory]
Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library /usr/local/apache-doris-2.0.3-bin-x64-noavx2/be/lib/hadoop_hdfs/native/libhadoop.so.1.0.0 which might have disabled stack guard
. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c
xiaokang
Search before asking
Version
2.0.2-bin-x64
What's Wrong?
I created a ngram bloomfilter index then ran build command on it. Then all be crashed.
What You Expected?
All BE can startup and work as normal.
How to Reproduce?
step 1: create a table say lineitem as below, then insert some lines Note: Actually this table was created by tpch-tool. But I don't think its relevant.
CREATE TABLE
lineitem(l_shipdatedate NOT NULL,l_orderkeybigint(20) NOT NULL,l_linenumberint(11) NOT NULL,l_partkeyint(11) NOT NULL,l_suppkeyint(11) NOT NULL,l_quantityDECIMAL(15, 2) NOT NULL,l_extendedpriceDECIMAL(15, 2) NOT NULL,l_discountDECIMAL(15, 2) NOT NULL,l_taxDECIMAL(15, 2) NOT NULL,l_returnflagvarchar(1) NOT NULL,l_linestatusvarchar(1) NOT NULL,l_commitdatedate NOT NULL,l_receiptdatedate NOT NULL,l_shipinstructvarchar(25) NOT NULL,l_shipmodevarchar(10) NOT NULL,l_commentvarchar(44) NOT NULL ) ENGINE=OLAP UNIQUE KEY(l_shipdate,l_orderkey) COMMENT 'OLAP' DISTRIBUTED BY HASH(l_orderkey) BUCKETS 96step 2: create a ngram bloomfilter on lineitem alter table lineitem add index idxngram(l_comment) using NGRAM_BF PROPERTIES("gram_size"="3", "bf_size"="512");
step 3: build the index which created in previous step. build index idxngram on lineitem;
Anything Else?
I know I probably should not run 'build index' on an ngram bloomfilter index. But Doris didn't reject it when run the command.
Crash stack:
start time: 2023年 12月 07日 星期四 18:24:09 CST INFO: java_cmd /usr/lib/jvm/openlogic-openjdk-8-hotspot/bin/java INFO: jdk_version 8 SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/data/apache-doris-2.0.2-bin-x64/be/lib/java_extensions/preload-extensions/preload-extensions-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/data/apache-doris-2.0.2-bin-x64/be/lib/java_extensions/java-udf/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/data/apache-doris-2.0.2-bin-x64/be/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory] OpenJDK 64-Bit Server VM warning: You have loaded library /data/apache-doris-2.0.2-bin-x64/be/lib/hadoop_hdfs/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now. It's highly recommended that you fix the library with 'execstack -c', or link it with '-z noexecstack'.
Query id: 0-0
tablet id: 0
Aborted at 1701944660 (unix time) try "date -d @1701944660" if you are using GNU date
Current BE git commitID: ae923f7
SIGSEGV address not mapped to object (@0x30) received by PID 247774 (TID 248522 OR 0x7e67a769f700) from PID 48; stack trace:
0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t, void) at /root/src/doris-2.0/be/src/common/signal_handler.h:417
1# os::Linux::chained_handler(int, siginfo_t, void) in /usr/lib/jvm/openlogic-openjdk-8-hotspot/jre/lib/amd64/server/libjvm.so
2# JVM_handle_linux_signal in /usr/lib/jvm/openlogic-openjdk-8-hotspot/jre/lib/amd64/server/libjvm.so
3# signalHandler(int, siginfo_t, void) in /usr/lib/jvm/openlogic-openjdk-8-hotspot/jre/lib/amd64/server/libjvm.so
4# 0x00007F091D6ECB80 in /usr/lib64/libc.so.6
5# doris::vectorized::OlapBlockDataConvertor::convert_column_data(unsigned long) at /root/src/doris-2.0/be/src/vec/olap/olap_data_convertor.cpp:222
6# doris::IndexBuilder::_write_inverted_index_data(std::shared_ptr, int, doris::vectorized::Block) at /root/src/doris-2.0/be/src/olap/task/index_builder.cpp:267
7# doris::IndexBuilder::handle_single_rowset(std::shared_ptr, std::vector<std::shared_ptr, std::allocator<std::shared_ptr > >&) at /root/src/doris-2.0/be/src/olap/task/index_builder.cpp:230
8# doris::IndexBuilder::handle_inverted_index_data() at /root/src/doris-2.0/be/src/olap/task/index_builder.cpp:397
9# doris::IndexBuilder::do_build_inverted_index() in /root/doris/be/lib/doris_be
10# doris::StorageEngine::_handle_index_change(std::shared_ptr) at /root/src/doris-2.0/be/src/olap/olap_server.cpp:1039
11# doris::StorageEngine::process_index_change_task(doris::TAlterInvertedIndexReq const&) at /root/src/doris-2.0/be/src/olap/olap_server.cpp:1033
12# doris::EngineIndexChangeTask::execute() at /root/src/doris-2.0/be/src/olap/task/engine_index_change_task.cpp:43
13# doris::StorageEngine::execute_task(doris::EngineTask ) at /root/src/doris-2.0/be/src/olap/storage_engine.cpp:1168
14# doris::TaskWorkerPool::_alter_inverted_index_worker_thread_callback() at /root/src/doris-2.0/be/src/agent/task_worker_pool.cpp:354
15# doris::ThreadPool::dispatch_thread() in /root/doris/be/lib/doris_be
16# doris::Thread::supervise_thread(void*) at /root/src/doris-2.0/be/src/util/thread.cpp:470
17# start_thread in /usr/lib64/libpthread.so.0
18# clone in /usr/lib64/libc.so.6
Are you willing to submit PR?
Code of Conduct