search

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.38k stars 3.22k forks source link

[Bug] be Accidental crash #22778

Open xingyingone opened 1 year ago

xingyingone commented 1 year ago

Search before asking

Version

hadoop@olap-test2:~/xingying01/doris/be/build_Debug/src/service$ /home/hadoop/xingying01/doris/be/build_Debug/src/service/doris_be --version doris-0.0.0-trunk(AVX2) DEBUG (build git:@d5d82b7c31a93dc9ad4443c35f9d7f3e9d380d1e) Built on Fri, 04 Aug 2023 16:03:35 CST by **

I build from d5d82b7c31a93dc9ad4443c35f9d7f3e9d380d1e in debug mode

What's Wrong?

be Accidental crash, I did it 10 times, and I probably repeated it twice twice. Unfortunately, however, gdb does not show the full stack。

I0809 15:10:00.325420 92538 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 15:10:00.325788 92538 task_worker_pool.cpp:1004] successfully report TABLET|host=10...87|port=9021 I0809 15:10:04.848225 92535 task_worker_pool.cpp:1004] successfully report TASK|host=10...87|port=9021 Signal: SIGSEGV (Segmentation fault) I0809 15:10:13.561190 92409 olap_server.cpp:1039] cooldown producer get tablet num: 0 Query id: b6402d68b31349f7-8ac0300877c35e3f Aborted at 1691565014 (unix time) try "date -d @1691565014" if you are using GNU date Current BE git commitID: d5d82b7 SIGSEGV invalid permissions for mapped object (@0x7fff7c61bb00) received by PID 43788 (TID 92840 OR 0x7ffd14482700) from PID 2086779648; stack trace: I0809 15:10:15.538467 67024 heartbeat_server.cpp:61] get heartbeat from FE.host:10...87, port:9021, cluster id:1477139465, counter:25, BE start time: 1691564868551 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t, void) at /home/hadoop/xingying01/doris/be/src/common/signal_handler.h:413 1# os::Linux::chained_handler(int, siginfo, void) in /home/hadoop/impala/packages/jdk1.8.0_152/jre/lib/amd64/server/libjvm.so 2# JVM_handle_linux_signal in /home/hadoop/impala/packages/jdk1.8.0_152/jre/lib/amd64/server/libjvm.so 3# signalHandler(int, siginfo, void) in /home/hadoop/impala/packages/jdk1.8.0_152/jre/lib/amd64/server/libjvm.so 4# 0x00007FFFF7621400 in /lib64/libc.so.6 5# 0x00007FFF7C61BB00

(gdb) bt

0 0x00007fff44d2d000 in ?? ()

1 0x000055556ee2a3f1 in doris::vectorized::IDataType::get_name[abi:cxx11]() const (this=0x7ffd15473bb0) at /home/hadoop/xingying01/doris/be/src/vec/data_types/data_type.cpp:49

2 0x00007ffd154736ff in ?? ()

3 0x0000000000000000 in ?? ()

image

What You Expected?

I wish some old drivers could guide me a little bit and I would be happy to fix this problem

How to Reproduce?

be Accidental crash, I did it 10 times, and I probably repeated it twice twice. The method of repetition is as follows:

CREATE TABLE test_map_agg_alex4 ( id int(11) NOT NULL, label_name varchar(32) default null, value_field string default null, ) ENGINE=OLAP DUPLICATE KEY(id) COMMENT 'OLAP' DISTRIBUTED BY HASH(id) BUCKETS 1 PROPERTIES ( "replication_allocation" = "tag.location.default: 1", "storage_format" = "V2", "light_schema_change" = "true", "disable_auto_compaction" = "false", "enable_single_replica_compaction" = "false" );

            insert into `test_map_agg_alex4` values
        (1, NULL,NULL),
        (1, "LB", "V1_2"),
        (1, "LC", "V1_3"),
        (2, "LA", "V2_1"),
        (2, "LB", "V2_2"),
        (2, NULL, "V2_3"),
        (3, "LA", "V3_1"),
        (3, NULL, NULL),
        (3, "LC", "V3_3"),
        (4, "LA", "V4_1"),
        (4, "LB", "V4_2"),
        (4, "LC", "V4_3"),
        (5, "LA", "V5_1"),
        (5, "LB", "V5_2"),
        (5, "LC", "V5_3");

SELECT id, map_agg(label_name,value_field) FROM test_map_agg_alex4 GROUP BY id;

Anything Else?

no

Are you willing to submit PR?

Code of Conduct

xingyingone commented 1 year ago

/home/hadoop/xingying01/doris/be/build_Debug/src/service/doris_be Signal: SIGSEGV (Segmentation fault) SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/hadoop/xingying01/doris/lib/java_extensions/hudi-scanner-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/hadoop/xingying01/doris/lib/java_extensions/paimon-scanner-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/hadoop/xingying01/doris/lib/java_extensions/jdbc-scanner-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/hadoop/xingying01/doris/lib/java_extensions/java-udf-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/hadoop/xingying01/doris/lib/java_extensions/avro-scanner-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/hadoop/xingying01/doris/lib/java_extensions/max-compute-scanner-jar-with-dependencies.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/hadoop/xingying01/doris/lib/hadoop_hdfs/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. Signal: SIGSEGV (Segmentation fault) log4j:ERROR setFile(null,true) call failed. java.io.FileNotFoundException: (No such file or directory) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.(FileOutputStream.java:213) at java.io.FileOutputStream.(FileOutputStream.java:133) at org.apache.log4j.FileAppender.setFile(FileAppender.java:282) at org.apache.log4j.RollingFileAppender.setFile(RollingFileAppender.java:200) at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:166) at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:284) at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:160) at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:100) at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:802) at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:738) at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:630) at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:516) at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:577) at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:504) at org.apache.log4j.LogManager.(LogManager.java:119) at org.slf4j.impl.Reload4jLoggerFactory.(Reload4jLoggerFactory.java:67) at org.slf4j.impl.StaticLoggerBinder.(StaticLoggerBinder.java:72) at org.slf4j.impl.StaticLoggerBinder.(StaticLoggerBinder.java:45) at org.slf4j.LoggerFactory.bind(LoggerFactory.java:150) at org.slf4j.LoggerFactory.performInitialization(LoggerFactory.java:124) at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:417) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:362) at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:155) at org.apache.commons.logging.impl.SLF4JLogFactory.getInstance(SLF4JLogFactory.java:132) at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:273) at org.apache.hadoop.fs.FileSystem.(FileSystem.java:186) SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory] Signal: SIGSEGV (Segmentation fault) I0809 19:38:35.194993 109959 daemon.cpp:436] version doris-0.0.0-trunk(AVX2) DEBUG (build git://palcement@d5d82b7c31a93dc9ad4443c35f9d7f3e9d380d1e) Built on Fri, 04 Aug 2023 16:03:35 CST by palcement I0809 19:38:35.212462 109959 mem_info.cpp:402] Physical Memory: 377.62 GB, Mem Limit: 302.10 GB, origin config value: 80%, System Mem Available Min Reserve: 1.60 GB, Vm Min Free KBytes: 88.00 MB, Vm Overcommit Memory: 0 I0809 19:38:35.215456 109959 daemon.cpp:444] Cpu Info: Model: Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz Cores: 48 Max Possible Cores: 48 L1 Cache: 32.00 KB (Line: 64.00 B) L2 Cache: 256.00 KB (Line: 64.00 B) L3 Cache: 30.00 MB (Line: 64.00 B) Hardware Supports: ssse3 sse4_1 sse4_2 popcnt avx avx2 Numa Nodes: 2 Numa Nodes of Cores: 0->0 | 1->1 | 2->0 | 3->1 | 4->0 | 5->1 | 6->0 | 7->1 | 8->0 | 9->1 | 10->0 | 11->1 | 12->0 | 13->1 | 14->0 | 15->1 | 16->0 | 17->1 | 18->0 | 19->1 | 20->0 | 21->1 | 22->0 | 23->1 | 24->0 | 25->1 | 26->0 | 27->1 | 28->0 | 29->1 | 30->0 | 31->1 | 32->0 | 33->1 | 34->0 | 35->1 | 36->0 | 37->1 | 38->0 | 39->1 | 40->0 | 41->1 | 42->0 | 43->1 | 44->0 | 45->1 | 46->0 | 47->1 | I0809 19:38:35.215535 109959 daemon.cpp:445] Disk Info: Num disks 3: sda, sdc, sdb I0809 19:38:35.215548 109959 daemon.cpp:446] Physical Memory: 377.62 GB Memory Limt: 302.10 GB CGroup Info: Process CGroup Info: memory.limit_in_bytes=9223372036854771712, cpu cfs limits: unlimited I0809 19:38:35.224200 109959 backend_options.cpp:87] local host ip=palcement W0809 19:38:35.225359 30780 local_file_system.cpp:298] [IO_ERROR]failed to list /proc/109959/fd/: (2), No such file or directory W0809 19:38:35.225464 30780 doris_metrics.cpp:379] failed to count fd: [IO_ERROR]failed to list /proc/109959/fd/: (2), No such file or directory I0809 19:38:35.306944 109959 task_scheduler.cpp:51] BlockedTaskScheduler start I0809 19:38:35.312294 109959 task_scheduler.cpp:58] BlockedTaskScheduler started I0809 19:38:35.325075 109959 task_scheduler.cpp:51] BlockedTaskScheduler start I0809 19:38:35.330446 109959 task_scheduler.cpp:58] BlockedTaskScheduler started I0809 19:38:35.330900 31192 fragment_mgr.cpp:1045] FragmentMgr cancel worker start working. E0809 19:38:35.752427 109959 variable.cpp:179] Already exposed doris_cache_obj_lrucache' whose value is0' E0809 19:38:35.752478 109959 variable.cpp:179] Already exposed doris_cache_obj_lrucache_persecond' whose value is0' I0809 19:38:35.752832 109959 load_path_mgr.cpp:71] Load path configured to [/home/hadoop/xingying01/doris/storage/mini_download] I0809 19:38:35.752893 31667 result_buffer_mgr.cpp:147] result buffer manager cancel thread begin. E0809 19:38:35.822525 109959 variable.cpp:179] Already exposed doris_cache_data_page_cache' whose value is0' E0809 19:38:35.822574 109959 variable.cpp:179] Already exposed doris_cache_data_page_cache_persecond' whose value is0' E0809 19:38:35.822870 109959 variable.cpp:179] Already exposed doris_cache_index_page_cache' whose value is0' E0809 19:38:35.822894 109959 variable.cpp:179] Already exposed doris_cache_index_page_cache_persecond' whose value is0' E0809 19:38:35.823195 109959 variable.cpp:179] Already exposed doris_cache_pkindex_page_cache' whose value is0' E0809 19:38:35.823218 109959 variable.cpp:179] Already exposed doris_cache_pkindex_page_cache_persecond' whose value is0' I0809 19:38:35.823232 109959 exec_env_init.cpp:261] Storage page cache memory limit: 60.42 GB, origin config value: 20% E0809 19:38:35.823410 109959 variable.cpp:179] Already exposed doris_cache_row_cache' whose value is0' E0809 19:38:35.823436 109959 variable.cpp:179] Already exposed doris_cache_row_cache_persecond' whose value is0' I0809 19:38:35.823449 109959 exec_env_init.cpp:274] Row cache memory limit: 60.42 GB, origin config value: 20% I0809 19:38:35.823462 109959 exec_env_init.cpp:290] segment_cache_capacity = fd_number * 2 / 5, fd_number: 655360 segment_cache_capacity: 262144 E0809 19:38:35.823555 109959 variable.cpp:179] Already exposed doris_cache_segment_cache' whose value is0' E0809 19:38:35.823578 109959 variable.cpp:179] Already exposed doris_cache_segment_cache_persecond' whose value is0' E0809 19:38:35.823680 109959 variable.cpp:179] Already exposed doris_cache_schema_cache' whose value is0' E0809 19:38:35.823721 109959 variable.cpp:179] Already exposed doris_cache_schema_cache_persecond' whose value is0' E0809 19:38:35.823822 109959 variable.cpp:179] Already exposed doris_cache_lookup_connection_cache' whose value is0' E0809 19:38:35.823844 109959 variable.cpp:179] Already exposed doris_cache_lookup_connection_cache_persecond' whose value is0' I0809 19:38:35.823907 109959 inverted_index_cache.cpp:80] fd_number: 655360, inverted index open searcher limit: 262144 E0809 19:38:35.823969 109959 variable.cpp:179] Already exposed doris_cache_inverted_index_searcher_cache' whose value is0' E0809 19:38:35.823997 109959 variable.cpp:179] Already exposed doris_cache_inverted_index_searcher_cache_persecond' whose value is0' I0809 19:38:35.824016 109959 exec_env_init.cpp:307] Inverted index searcher cache memory limit: 30.21 GB, origin config value: 10% E0809 19:38:35.824129 109959 variable.cpp:179] Already exposed doris_cache_inverted_index_query_cache' whose value is0' E0809 19:38:35.824155 109959 variable.cpp:179] Already exposed doris_cache_inverted_index_query_cache_persecond' whose value is0' I0809 19:38:35.824168 109959 exec_env_init.cpp:320] Inverted index query match cache memory limit: 30.21 GB, origin config value: 10% E0809 19:38:35.824429 109959 variable.cpp:179] Already exposed doris_cache_lastest_success_channel_cache' whose value is0' E0809 19:38:35.824456 109959 variable.cpp:179] Already exposed doris_cache_lastest_success_channel_cache_persecond' whose value is0' I0809 19:38:35.836336 109959 s3_file_write_bufferpool.cpp:72] S3 file buffer pool with 100 buffers I0809 19:38:35.937145 30775 daemon.cpp:218] OS physical memory 377.62 GB. Process memory usage 823.91 MB, limit 302.10 GB, soft limit 271.89 GB. Sys available memory 344.01 GB, low water mark 1.60 GB, warning water mark 3.20 GB. Refresh interval memory growth 0 B I0809 19:38:36.123916 109959 storage_engine.cpp:108] starting backend using uid:c54a14f673a15c59-b0b8b3d2a19a23a8 E0809 19:38:36.124488 109959 variable.cpp:179] Already exposed doris_cache_tablet_version_cache' whose value is0' E0809 19:38:36.124527 109959 variable.cpp:179] Already exposed doris_cache_tablet_version_cache_persecond' whose value is0' I0809 19:38:36.125528 32262 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155974053888 I0809 19:38:36.130455 32262 data_dir.cpp:188] path: /home/hadoop/xingying01/doris/storage, hash: 17121206805804334263 I0809 19:38:36.138550 32262 olap_meta.cpp:68] [Rocksdb] RocksDB version: 5.14.2 I0809 19:38:36.138571 32262 olap_meta.cpp:68] [Rocksdb] Git sha rocksdb_build_git_sha: I0809 19:38:36.138576 32262 olap_meta.cpp:68] [Rocksdb] Compile date Jul 18 2023 I0809 19:38:36.138585 32262 olap_meta.cpp:68] [Rocksdb] DB SUMMARY I0809 19:38:36.138656 32262 olap_meta.cpp:68] [Rocksdb] CURRENT file: CURRENT I0809 19:38:36.138666 32262 olap_meta.cpp:68] [Rocksdb] IDENTITY file: IDENTITY I0809 19:38:36.138679 32262 olap_meta.cpp:68] [Rocksdb] MANIFEST file: MANIFEST-000233 size: 512 Bytes I0809 19:38:36.138691 32262 olap_meta.cpp:68] [Rocksdb] SST files in /home/hadoop/xingying01/doris/storage/meta dir, Total Num: 2, files: 000224.sst 000227.sst I0809 19:38:36.138700 32262 olap_meta.cpp:68] [Rocksdb] Write Ahead Log file in /home/hadoop/xingying01/doris/storage/meta: 000234.log size: 0 ; I0809 19:38:36.138710 32262 olap_meta.cpp:68] [Rocksdb] Options.error_if_exists: 0 I0809 19:38:36.138717 32262 olap_meta.cpp:68] [Rocksdb] Options.create_if_missing: 1 I0809 19:38:36.138723 32262 olap_meta.cpp:68] [Rocksdb] Options.paranoid_checks: 1 I0809 19:38:36.138732 32262 olap_meta.cpp:68] [Rocksdb] Options.env: 0x555579550650 I0809 19:38:36.138739 32262 olap_meta.cpp:68] [Rocksdb] Options.info_log: 0x7fff972135f0 I0809 19:38:36.138749 32262 olap_meta.cpp:68] [Rocksdb] Options.max_file_opening_threads: 16 I0809 19:38:36.138775 32262 olap_meta.cpp:68] [Rocksdb] Options.statistics: (nil) I0809 19:38:36.138783 32262 olap_meta.cpp:68] [Rocksdb] Options.use_fsync: 0 I0809 19:38:36.138789 32262 olap_meta.cpp:68] [Rocksdb] Options.max_log_file_size: 0 I0809 19:38:36.138797 32262 olap_meta.cpp:68] [Rocksdb] Options.max_manifest_file_size: 18446744073709551615 I0809 19:38:36.138804 32262 olap_meta.cpp:68] [Rocksdb] Options.log_file_time_to_roll: 0 I0809 19:38:36.138811 32262 olap_meta.cpp:68] [Rocksdb] Options.keep_log_file_num: 1000 I0809 19:38:36.138818 32262 olap_meta.cpp:68] [Rocksdb] Options.recycle_log_file_num: 0 I0809 19:38:36.138825 32262 olap_meta.cpp:68] [Rocksdb] Options.allow_fallocate: 1 I0809 19:38:36.138831 32262 olap_meta.cpp:68] [Rocksdb] Options.allow_mmap_reads: 0 I0809 19:38:36.138839 32262 olap_meta.cpp:68] [Rocksdb] Options.allow_mmap_writes: 0 I0809 19:38:36.138844 32262 olap_meta.cpp:68] [Rocksdb] Options.use_direct_reads: 0 I0809 19:38:36.138851 32262 olap_meta.cpp:68] [Rocksdb] Options.use_direct_io_for_flush_and_compaction: 0 I0809 19:38:36.138857 32262 olap_meta.cpp:68] [Rocksdb] Options.create_missing_column_families: 1 I0809 19:38:36.138864 32262 olap_meta.cpp:68] [Rocksdb] Options.db_log_dir: I0809 19:38:36.138871 32262 olap_meta.cpp:68] [Rocksdb] Options.wal_dir: /home/hadoop/xingying01/doris/storage/meta I0809 19:38:36.138877 32262 olap_meta.cpp:68] [Rocksdb] Options.table_cache_numshardbits: 6 I0809 19:38:36.138885 32262 olap_meta.cpp:68] [Rocksdb] Options.max_subcompactions: 1 I0809 19:38:36.138890 32262 olap_meta.cpp:68] [Rocksdb] Options.max_background_flushes: -1 I0809 19:38:36.138897 32262 olap_meta.cpp:68] [Rocksdb] Options.WAL_ttl_seconds: 0 I0809 19:38:36.138903 32262 olap_meta.cpp:68] [Rocksdb] Options.WAL_size_limit_MB: 0 I0809 19:38:36.138911 32262 olap_meta.cpp:68] [Rocksdb] Options.manifest_preallocation_size: 4194304 I0809 19:38:36.138916 32262 olap_meta.cpp:68] [Rocksdb] Options.is_fd_close_on_exec: 1 I0809 19:38:36.138923 32262 olap_meta.cpp:68] [Rocksdb] Options.advise_random_on_open: 1 I0809 19:38:36.138929 32262 olap_meta.cpp:68] [Rocksdb] Options.db_write_buffer_size: 0 I0809 19:38:36.138935 32262 olap_meta.cpp:68] [Rocksdb] Options.write_buffer_manager: 0x7fff97213670 I0809 19:38:36.138942 32262 olap_meta.cpp:68] [Rocksdb] Options.access_hint_on_compaction_start: 1 I0809 19:38:36.138948 32262 olap_meta.cpp:68] [Rocksdb] Options.new_table_reader_for_compaction_inputs: 0 I0809 19:38:36.138955 32262 olap_meta.cpp:68] [Rocksdb] Options.random_access_max_buffer_size: 1048576 I0809 19:38:36.138962 32262 olap_meta.cpp:68] [Rocksdb] Options.use_adaptive_mutex: 0 I0809 19:38:36.138968 32262 olap_meta.cpp:68] [Rocksdb] Options.rate_limiter: (nil) I0809 19:38:36.138974 32262 olap_meta.cpp:68] [Rocksdb] Options.sst_file_manager.rate_bytes_per_sec: 0 I0809 19:38:36.138983 32262 olap_meta.cpp:68] [Rocksdb] Options.wal_recovery_mode: 2 I0809 19:38:36.138990 32262 olap_meta.cpp:68] [Rocksdb] Options.enable_thread_tracking: 0 I0809 19:38:36.138998 32262 olap_meta.cpp:68] [Rocksdb] Options.enable_pipelined_write: 0 I0809 19:38:36.139004 32262 olap_meta.cpp:68] [Rocksdb] Options.allow_concurrent_memtable_write: 1 I0809 19:38:36.139011 32262 olap_meta.cpp:68] [Rocksdb] Options.enable_write_thread_adaptive_yield: 1 I0809 19:38:36.139019 32262 olap_meta.cpp:68] [Rocksdb] Options.write_thread_max_yield_usec: 100 I0809 19:38:36.139026 32262 olap_meta.cpp:68] [Rocksdb] Options.write_thread_slow_yield_usec: 3 I0809 19:38:36.139042 32262 olap_meta.cpp:68] [Rocksdb] Options.row_cache: None I0809 19:38:36.139050 32262 olap_meta.cpp:68] [Rocksdb] Options.wal_filter: None I0809 19:38:36.139057 32262 olap_meta.cpp:68] [Rocksdb] Options.avoid_flush_during_recovery: 0 I0809 19:38:36.139063 32262 olap_meta.cpp:68] [Rocksdb] Options.allow_ingest_behind: 0 I0809 19:38:36.139071 32262 olap_meta.cpp:68] [Rocksdb] Options.preserve_deletes: 0 I0809 19:38:36.139078 32262 olap_meta.cpp:68] [Rocksdb] Options.two_write_queues: 0 I0809 19:38:36.139086 32262 olap_meta.cpp:68] [Rocksdb] Options.manual_wal_flush: 0 I0809 19:38:36.139092 32262 olap_meta.cpp:68] [Rocksdb] Options.max_background_jobs: 16 I0809 19:38:36.139099 32262 olap_meta.cpp:68] [Rocksdb] Options.max_background_compactions: -1 I0809 19:38:36.139106 32262 olap_meta.cpp:68] [Rocksdb] Options.avoid_flush_during_shutdown: 0 I0809 19:38:36.139113 32262 olap_meta.cpp:68] [Rocksdb] Options.writable_file_max_buffer_size: 1048576 I0809 19:38:36.139120 32262 olap_meta.cpp:68] [Rocksdb] Options.delayed_write_rate : 16777216 I0809 19:38:36.139127 32262 olap_meta.cpp:68] [Rocksdb] Options.max_total_wal_size: 0 I0809 19:38:36.139133 32262 olap_meta.cpp:68] [Rocksdb] Options.delete_obsolete_files_period_micros: 21600000000 I0809 19:38:36.139140 32262 olap_meta.cpp:68] [Rocksdb] Options.stats_dump_period_sec: 600 I0809 19:38:36.139147 32262 olap_meta.cpp:68] [Rocksdb] Options.max_open_files: -1 I0809 19:38:36.139154 32262 olap_meta.cpp:68] [Rocksdb] Options.bytes_per_sync: 0 I0809 19:38:36.139160 32262 olap_meta.cpp:68] [Rocksdb] Options.wal_bytes_per_sync: 0 I0809 19:38:36.139168 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_readahead_size: 0 I0809 19:38:36.139174 32262 olap_meta.cpp:68] [Rocksdb] Compression algorithms supported: I0809 19:38:36.139183 32262 olap_meta.cpp:68] [Rocksdb] kZSTD supported: 1 I0809 19:38:36.139190 32262 olap_meta.cpp:68] [Rocksdb] kXpressCompression supported: 0 I0809 19:38:36.139197 32262 olap_meta.cpp:68] [Rocksdb] kBZip2Compression supported: 1 I0809 19:38:36.139204 32262 olap_meta.cpp:68] [Rocksdb] kZSTDNotFinalCompression supported: 1 I0809 19:38:36.139211 32262 olap_meta.cpp:68] [Rocksdb] kLZ4Compression supported: 1 I0809 19:38:36.139217 32262 olap_meta.cpp:68] [Rocksdb] kZlibCompression supported: 1 I0809 19:38:36.139225 32262 olap_meta.cpp:68] [Rocksdb] kLZ4HCCompression supported: 1 I0809 19:38:36.139231 32262 olap_meta.cpp:68] [Rocksdb] kSnappyCompression supported: 1 I0809 19:38:36.139246 32262 olap_meta.cpp:68] [Rocksdb] Fast CRC32 supported: Not supported on x86 I0809 19:38:36.139567 32262 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:3085] Recovering from manifest file: MANIFEST-000233 I0809 19:38:36.139703 32262 olap_meta.cpp:68] [Rocksdb] [db/column_family.cc:475] --------------- Options for column family [default]: I0809 19:38:36.139714 32262 olap_meta.cpp:68] [Rocksdb] Options.comparator: leveldb.BytewiseComparator I0809 19:38:36.139720 32262 olap_meta.cpp:68] [Rocksdb] Options.merge_operator: None I0809 19:38:36.139725 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_filter: None I0809 19:38:36.139730 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_filter_factory: None I0809 19:38:36.139741 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_factory: SkipListFactory I0809 19:38:36.139748 32262 olap_meta.cpp:68] [Rocksdb] Options.table_factory: BlockBasedTable I0809 19:38:36.139791 32262 olap_meta.cpp:68] [Rocksdb] table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7fff97263008) cache_index_and_filter_blocks: 0 cache_index_and_filter_blocks_with_high_priority: 0 pin_l0_filter_and_index_blocks_in_cache: 0 index_type: 0 hash_index_allow_collision: 1 checksum: 1 no_block_cache: 0 block_cache: 0x7fff97219790 block_cache_name: LRUCache block_cache_options: capacity : 8388608 num_shard_bits : 4 strict_capacity_limit : 0 high_pri_pool_ratio: 0.000 block_cache_compressed: (nil) persistent_cache: (nil) block_size: 4096 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 metadata_block_size: 4096 partition_filters: 0 use_delta_encoding: 1 filter_policy: nullptr whole_key_filtering: 1 verify_compression: 0 read_amp_bytes_per_bit: 0 format_version: 2 enable_index_compression: 1 block_align: 0 I0809 19:38:36.139815 32262 olap_meta.cpp:68] [Rocksdb] Options.write_buffer_size: 67108864 I0809 19:38:36.139823 32262 olap_meta.cpp:68] [Rocksdb] Options.max_write_buffer_number: 2 I0809 19:38:36.139830 32262 olap_meta.cpp:68] [Rocksdb] Options.compression: Snappy I0809 19:38:36.139837 32262 olap_meta.cpp:68] [Rocksdb] Options.bottommost_compression: Disabled I0809 19:38:36.139844 32262 olap_meta.cpp:68] [Rocksdb] Options.prefix_extractor: nullptr I0809 19:38:36.139851 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_insert_with_hint_prefix_extractor: nullptr I0809 19:38:36.139858 32262 olap_meta.cpp:68] [Rocksdb] Options.num_levels: 7 I0809 19:38:36.139864 32262 olap_meta.cpp:68] [Rocksdb] Options.min_write_buffer_number_to_merge: 1 I0809 19:38:36.139871 32262 olap_meta.cpp:68] [Rocksdb] Options.max_write_buffer_number_to_maintain: 0 I0809 19:38:36.139878 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.window_bits: -14 I0809 19:38:36.139885 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.level: -1 I0809 19:38:36.139892 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.strategy: 0 I0809 19:38:36.139899 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.max_dict_bytes: 0 I0809 19:38:36.139905 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.zstd_max_train_bytes: 0 I0809 19:38:36.139911 32262 olap_meta.cpp:68] [Rocksdb] Options.level0_file_num_compaction_trigger: 4 I0809 19:38:36.139919 32262 olap_meta.cpp:68] [Rocksdb] Options.level0_slowdown_writes_trigger: 20 I0809 19:38:36.139925 32262 olap_meta.cpp:68] [Rocksdb] Options.level0_stop_writes_trigger: 36 I0809 19:38:36.139931 32262 olap_meta.cpp:68] [Rocksdb] Options.target_file_size_base: 67108864 I0809 19:38:36.139938 32262 olap_meta.cpp:68] [Rocksdb] Options.target_file_size_multiplier: 1 I0809 19:38:36.139945 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_base: 268435456 I0809 19:38:36.139951 32262 olap_meta.cpp:68] [Rocksdb] Options.level_compaction_dynamic_level_bytes: 0 I0809 19:38:36.139959 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier: 10.000000 I0809 19:38:36.139966 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[0]: 1 I0809 19:38:36.139973 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[1]: 1 I0809 19:38:36.139981 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[2]: 1 I0809 19:38:36.139987 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[3]: 1 I0809 19:38:36.139994 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[4]: 1 I0809 19:38:36.140000 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[5]: 1 I0809 19:38:36.140007 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[6]: 1 I0809 19:38:36.140013 32262 olap_meta.cpp:68] [Rocksdb] Options.max_sequential_skip_in_iterations: 8 I0809 19:38:36.140019 32262 olap_meta.cpp:68] [Rocksdb] Options.max_compaction_bytes: 1677721600 I0809 19:38:36.140026 32262 olap_meta.cpp:68] [Rocksdb] Options.arena_block_size: 8388608 I0809 19:38:36.140041 32262 olap_meta.cpp:68] [Rocksdb] Options.soft_pending_compaction_bytes_limit: 68719476736 I0809 19:38:36.140048 32262 olap_meta.cpp:68] [Rocksdb] Options.hard_pending_compaction_bytes_limit: 274877906944 I0809 19:38:36.140054 32262 olap_meta.cpp:68] [Rocksdb] Options.rate_limit_delay_max_milliseconds: 100 I0809 19:38:36.140060 32262 olap_meta.cpp:68] [Rocksdb] Options.disable_auto_compactions: 0 I0809 19:38:36.140071 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_style: kCompactionStyleLevel I0809 19:38:36.140079 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_pri: kByCompensatedSize I0809 19:38:36.140086 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.size_ratio: 1 I0809 19:38:36.140094 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.min_merge_width: 2 I0809 19:38:36.140100 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_merge_width: 4294967295 I0809 19:38:36.140107 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_size_amplification_percent: 200 I0809 19:38:36.140115 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.compression_size_percent: -1 I0809 19:38:36.140121 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize I0809 19:38:36.140128 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.max_table_files_size: 1073741824 I0809 19:38:36.140136 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.allow_compaction: 0 I0809 19:38:36.140142 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.ttl: 0 I0809 19:38:36.140149 32262 olap_meta.cpp:68] [Rocksdb] Options.table_properties_collectors: I0809 19:38:36.140156 32262 olap_meta.cpp:68] [Rocksdb] Options.inplace_update_support: 0 I0809 19:38:36.140163 32262 olap_meta.cpp:68] [Rocksdb] Options.inplace_update_num_locks: 10000 I0809 19:38:36.140170 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_prefix_bloom_size_ratio: 0.000000 I0809 19:38:36.140177 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_huge_page_size: 0 I0809 19:38:36.140183 32262 olap_meta.cpp:68] [Rocksdb] Options.bloom_locality: 0 I0809 19:38:36.140190 32262 olap_meta.cpp:68] [Rocksdb] Options.max_successive_merges: 0 I0809 19:38:36.140197 32262 olap_meta.cpp:68] [Rocksdb] Options.optimize_filters_for_hits: 0 I0809 19:38:36.140204 32262 olap_meta.cpp:68] [Rocksdb] Options.paranoid_file_checks: 0 I0809 19:38:36.140213 32262 olap_meta.cpp:68] [Rocksdb] Options.force_consistency_checks: 0 I0809 19:38:36.140219 32262 olap_meta.cpp:68] [Rocksdb] Options.report_bg_io_stats: 0 I0809 19:38:36.140225 32262 olap_meta.cpp:68] [Rocksdb] Options.ttl: 0 I0809 19:38:36.140370 32262 olap_meta.cpp:68] [Rocksdb] [db/column_family.cc:475] --------------- Options for column family [doris]: I0809 19:38:36.140385 32262 olap_meta.cpp:68] [Rocksdb] Options.comparator: leveldb.BytewiseComparator I0809 19:38:36.140393 32262 olap_meta.cpp:68] [Rocksdb] Options.merge_operator: None I0809 19:38:36.140399 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_filter: None I0809 19:38:36.140405 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_filter_factory: None I0809 19:38:36.140414 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_factory: SkipListFactory I0809 19:38:36.140420 32262 olap_meta.cpp:68] [Rocksdb] Options.table_factory: BlockBasedTable I0809 19:38:36.140452 32262 olap_meta.cpp:68] [Rocksdb] table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7fff97263010) cache_index_and_filter_blocks: 0 cache_index_and_filter_blocks_with_high_priority: 0 pin_l0_filter_and_index_blocks_in_cache: 0 index_type: 0 hash_index_allow_collision: 1 checksum: 1 no_block_cache: 0 block_cache: 0x7fff97219800 block_cache_name: LRUCache block_cache_options: capacity : 8388608 num_shard_bits : 4 strict_capacity_limit : 0 high_pri_pool_ratio: 0.000 block_cache_compressed: (nil) persistent_cache: (nil) block_size: 4096 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 metadata_block_size: 4096 partition_filters: 0 use_delta_encoding: 1 filter_policy: nullptr whole_key_filtering: 1 verify_compression: 0 read_amp_bytes_per_bit: 0 format_version: 2 enable_index_compression: 1 block_align: 0 I0809 19:38:36.140477 32262 olap_meta.cpp:68] [Rocksdb] Options.write_buffer_size: 67108864 I0809 19:38:36.140484 32262 olap_meta.cpp:68] [Rocksdb] Options.max_write_buffer_number: 2 I0809 19:38:36.140491 32262 olap_meta.cpp:68] [Rocksdb] Options.compression: Snappy I0809 19:38:36.140497 32262 olap_meta.cpp:68] [Rocksdb] Options.bottommost_compression: Disabled I0809 19:38:36.140503 32262 olap_meta.cpp:68] [Rocksdb] Options.prefix_extractor: nullptr I0809 19:38:36.140511 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_insert_with_hint_prefix_extractor: nullptr I0809 19:38:36.140516 32262 olap_meta.cpp:68] [Rocksdb] Options.num_levels: 7 I0809 19:38:36.140522 32262 olap_meta.cpp:68] [Rocksdb] Options.min_write_buffer_number_to_merge: 1 I0809 19:38:36.140529 32262 olap_meta.cpp:68] [Rocksdb] Options.max_write_buffer_number_to_maintain: 0 I0809 19:38:36.140535 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.window_bits: -14 I0809 19:38:36.140542 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.level: -1 I0809 19:38:36.140549 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.strategy: 0 I0809 19:38:36.140555 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.max_dict_bytes: 0 I0809 19:38:36.140561 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.zstd_max_train_bytes: 0 I0809 19:38:36.140568 32262 olap_meta.cpp:68] [Rocksdb] Options.level0_file_num_compaction_trigger: 4 I0809 19:38:36.140574 32262 olap_meta.cpp:68] [Rocksdb] Options.level0_slowdown_writes_trigger: 20 I0809 19:38:36.140581 32262 olap_meta.cpp:68] [Rocksdb] Options.level0_stop_writes_trigger: 36 I0809 19:38:36.140587 32262 olap_meta.cpp:68] [Rocksdb] Options.target_file_size_base: 67108864 I0809 19:38:36.140594 32262 olap_meta.cpp:68] [Rocksdb] Options.target_file_size_multiplier: 1 I0809 19:38:36.140600 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_base: 268435456 I0809 19:38:36.140607 32262 olap_meta.cpp:68] [Rocksdb] Options.level_compaction_dynamic_level_bytes: 0 I0809 19:38:36.140614 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier: 10.000000 I0809 19:38:36.140621 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[0]: 1 I0809 19:38:36.140628 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[1]: 1 I0809 19:38:36.140635 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[2]: 1 I0809 19:38:36.140640 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[3]: 1 I0809 19:38:36.140647 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[4]: 1 I0809 19:38:36.140655 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[5]: 1 I0809 19:38:36.140661 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[6]: 1 I0809 19:38:36.140667 32262 olap_meta.cpp:68] [Rocksdb] Options.max_sequential_skip_in_iterations: 8 I0809 19:38:36.140673 32262 olap_meta.cpp:68] [Rocksdb] Options.max_compaction_bytes: 1677721600 I0809 19:38:36.140681 32262 olap_meta.cpp:68] [Rocksdb] Options.arena_block_size: 8388608 I0809 19:38:36.140694 32262 olap_meta.cpp:68] [Rocksdb] Options.soft_pending_compaction_bytes_limit: 68719476736 I0809 19:38:36.140700 32262 olap_meta.cpp:68] [Rocksdb] Options.hard_pending_compaction_bytes_limit: 274877906944 I0809 19:38:36.140708 32262 olap_meta.cpp:68] [Rocksdb] Options.rate_limit_delay_max_milliseconds: 100 I0809 19:38:36.140715 32262 olap_meta.cpp:68] [Rocksdb] Options.disable_auto_compactions: 0 I0809 19:38:36.140723 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_style: kCompactionStyleLevel I0809 19:38:36.140730 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_pri: kByCompensatedSize I0809 19:38:36.140738 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.size_ratio: 1 I0809 19:38:36.140743 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.min_merge_width: 2 I0809 19:38:36.140751 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_merge_width: 4294967295 I0809 19:38:36.140758 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_size_amplification_percent: 200 I0809 19:38:36.140764 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.compression_size_percent: -1 I0809 19:38:36.140770 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize I0809 19:38:36.140777 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.max_table_files_size: 1073741824 I0809 19:38:36.140784 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.allow_compaction: 0 I0809 19:38:36.140794 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.ttl: 0 I0809 19:38:36.140800 32262 olap_meta.cpp:68] [Rocksdb] Options.table_properties_collectors: I0809 19:38:36.140807 32262 olap_meta.cpp:68] [Rocksdb] Options.inplace_update_support: 0 I0809 19:38:36.140813 32262 olap_meta.cpp:68] [Rocksdb] Options.inplace_update_num_locks: 10000 I0809 19:38:36.140821 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_prefix_bloom_size_ratio: 0.000000 I0809 19:38:36.140827 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_huge_page_size: 0 I0809 19:38:36.140836 32262 olap_meta.cpp:68] [Rocksdb] Options.bloom_locality: 0 I0809 19:38:36.140841 32262 olap_meta.cpp:68] [Rocksdb] Options.max_successive_merges: 0 I0809 19:38:36.140848 32262 olap_meta.cpp:68] [Rocksdb] Options.optimize_filters_for_hits: 0 I0809 19:38:36.140854 32262 olap_meta.cpp:68] [Rocksdb] Options.paranoid_file_checks: 0 I0809 19:38:36.140862 32262 olap_meta.cpp:68] [Rocksdb] Options.force_consistency_checks: 0 I0809 19:38:36.140868 32262 olap_meta.cpp:68] [Rocksdb] Options.report_bg_io_stats: 0 I0809 19:38:36.140875 32262 olap_meta.cpp:68] [Rocksdb] Options.ttl: 0 I0809 19:38:36.140921 32262 olap_meta.cpp:68] [Rocksdb] [db/column_family.cc:475] --------------- Options for column family [meta]: I0809 19:38:36.140931 32262 olap_meta.cpp:68] [Rocksdb] Options.comparator: leveldb.BytewiseComparator I0809 19:38:36.140937 32262 olap_meta.cpp:68] [Rocksdb] Options.merge_operator: None I0809 19:38:36.140944 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_filter: None I0809 19:38:36.140950 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_filter_factory: None I0809 19:38:36.140957 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_factory: SkipListFactory I0809 19:38:36.140964 32262 olap_meta.cpp:68] [Rocksdb] Options.table_factory: BlockBasedTable I0809 19:38:36.141000 32262 olap_meta.cpp:68] [Rocksdb] table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7fff97263018) cache_index_and_filter_blocks: 0 cache_index_and_filter_blocks_with_high_priority: 0 pin_l0_filter_and_index_blocks_in_cache: 0 index_type: 0 hash_index_allow_collision: 1 checksum: 1 no_block_cache: 0 block_cache: 0x7fff97219870 block_cache_name: LRUCache block_cache_options: capacity : 8388608 num_shard_bits : 4 strict_capacity_limit : 0 high_pri_pool_ratio: 0.000 block_cache_compressed: (nil) persistent_cache: (nil) block_size: 4096 block_size_deviation: 10 block_restart_interval: 16 index_block_restart_interval: 1 metadata_block_size: 4096 partition_filters: 0 use_delta_encoding: 1 filter_policy: nullptr whole_key_filtering: 1 verify_compression: 0 read_amp_bytes_per_bit: 0 format_version: 2 enable_index_compression: 1 block_align: 0 I0809 19:38:36.141019 32262 olap_meta.cpp:68] [Rocksdb] Options.write_buffer_size: 67108864 I0809 19:38:36.141026 32262 olap_meta.cpp:68] [Rocksdb] Options.max_write_buffer_number: 5 I0809 19:38:36.141033 32262 olap_meta.cpp:68] [Rocksdb] Options.compression: Snappy I0809 19:38:36.141039 32262 olap_meta.cpp:68] [Rocksdb] Options.bottommost_compression: Disabled I0809 19:38:36.141047 32262 olap_meta.cpp:68] [Rocksdb] Options.prefix_extractor: rocksdb.FixedPrefix.4 I0809 19:38:36.141052 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_insert_with_hint_prefix_extractor: nullptr I0809 19:38:36.141059 32262 olap_meta.cpp:68] [Rocksdb] Options.num_levels: 7 I0809 19:38:36.141065 32262 olap_meta.cpp:68] [Rocksdb] Options.min_write_buffer_number_to_merge: 1 I0809 19:38:36.141072 32262 olap_meta.cpp:68] [Rocksdb] Options.max_write_buffer_number_to_maintain: 0 I0809 19:38:36.141078 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.window_bits: -14 I0809 19:38:36.141085 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.level: -1 I0809 19:38:36.141091 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.strategy: 0 I0809 19:38:36.141098 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.max_dict_bytes: 0 I0809 19:38:36.141104 32262 olap_meta.cpp:68] [Rocksdb] Options.compression_opts.zstd_max_train_bytes: 0 I0809 19:38:36.141110 32262 olap_meta.cpp:68] [Rocksdb] Options.level0_file_num_compaction_trigger: 4 I0809 19:38:36.141117 32262 olap_meta.cpp:68] [Rocksdb] Options.level0_slowdown_writes_trigger: 20 I0809 19:38:36.141124 32262 olap_meta.cpp:68] [Rocksdb] Options.level0_stop_writes_trigger: 36 I0809 19:38:36.141129 32262 olap_meta.cpp:68] [Rocksdb] Options.target_file_size_base: 67108864 I0809 19:38:36.141136 32262 olap_meta.cpp:68] [Rocksdb] Options.target_file_size_multiplier: 1 I0809 19:38:36.141142 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_base: 268435456 I0809 19:38:36.141148 32262 olap_meta.cpp:68] [Rocksdb] Options.level_compaction_dynamic_level_bytes: 0 I0809 19:38:36.141156 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier: 10.000000 I0809 19:38:36.141163 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[0]: 1 I0809 19:38:36.141170 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[1]: 1 I0809 19:38:36.141176 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[2]: 1 I0809 19:38:36.141182 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[3]: 1 I0809 19:38:36.141189 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[4]: 1 I0809 19:38:36.141196 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[5]: 1 I0809 19:38:36.141202 32262 olap_meta.cpp:68] [Rocksdb] Options.max_bytes_for_level_multiplier_addtl[6]: 1 I0809 19:38:36.141208 32262 olap_meta.cpp:68] [Rocksdb] Options.max_sequential_skip_in_iterations: 8 I0809 19:38:36.141214 32262 olap_meta.cpp:68] [Rocksdb] Options.max_compaction_bytes: 1677721600 I0809 19:38:36.141222 32262 olap_meta.cpp:68] [Rocksdb] Options.arena_block_size: 8388608 I0809 19:38:36.141235 32262 olap_meta.cpp:68] [Rocksdb] Options.soft_pending_compaction_bytes_limit: 68719476736 I0809 19:38:36.141242 32262 olap_meta.cpp:68] [Rocksdb] Options.hard_pending_compaction_bytes_limit: 274877906944 I0809 19:38:36.141248 32262 olap_meta.cpp:68] [Rocksdb] Options.rate_limit_delay_max_milliseconds: 100 I0809 19:38:36.141254 32262 olap_meta.cpp:68] [Rocksdb] Options.disable_auto_compactions: 0 I0809 19:38:36.141261 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_style: kCompactionStyleLevel I0809 19:38:36.141268 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_pri: kByCompensatedSize I0809 19:38:36.141275 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.size_ratio: 1 I0809 19:38:36.141281 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.min_merge_width: 2 I0809 19:38:36.141297 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_merge_width: 4294967295 I0809 19:38:36.141304 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.max_size_amplification_percent: 200 I0809 19:38:36.141311 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.compression_size_percent: -1 I0809 19:38:36.141319 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize I0809 19:38:36.141325 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.max_table_files_size: 1073741824 I0809 19:38:36.141331 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.allow_compaction: 0 I0809 19:38:36.141337 32262 olap_meta.cpp:68] [Rocksdb] Options.compaction_options_fifo.ttl: 0 I0809 19:38:36.141345 32262 olap_meta.cpp:68] [Rocksdb] Options.table_properties_collectors: I0809 19:38:36.141350 32262 olap_meta.cpp:68] [Rocksdb] Options.inplace_update_support: 0 I0809 19:38:36.141356 32262 olap_meta.cpp:68] [Rocksdb] Options.inplace_update_num_locks: 10000 I0809 19:38:36.141366 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_prefix_bloom_size_ratio: 0.000000 I0809 19:38:36.141371 32262 olap_meta.cpp:68] [Rocksdb] Options.memtable_huge_page_size: 0 I0809 19:38:36.141378 32262 olap_meta.cpp:68] [Rocksdb] Options.bloom_locality: 0 I0809 19:38:36.141384 32262 olap_meta.cpp:68] [Rocksdb] Options.max_successive_merges: 0 I0809 19:38:36.141391 32262 olap_meta.cpp:68] [Rocksdb] Options.optimize_filters_for_hits: 0 I0809 19:38:36.141397 32262 olap_meta.cpp:68] [Rocksdb] Options.paranoid_file_checks: 0 I0809 19:38:36.141403 32262 olap_meta.cpp:68] [Rocksdb] Options.force_consistency_checks: 0 I0809 19:38:36.141410 32262 olap_meta.cpp:68] [Rocksdb] Options.report_bg_io_stats: 0 I0809 19:38:36.141417 32262 olap_meta.cpp:68] [Rocksdb] Options.ttl: 0 I0809 19:38:36.144670 30775 daemon.cpp:218] OS physical memory 377.62 GB. Process memory usage 1.16 GB, limit 302.10 GB, soft limit 271.89 GB. Sys available memory 343.66 GB, low water mark 1.60 GB, warning water mark 3.20 GB. Refresh interval memory growth 0 B I0809 19:38:36.164053 32262 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:3361] Recovered from manifest file:/home/hadoop/xingying01/doris/storage/meta/MANIFEST-000233 succeeded,manifest_file_number is 233, next_file_number is 235, last_sequence is 357986, log_number is 0,prev_log_number is 0,max_column_family is 2,min_log_number_to_keep is 0 I0809 19:38:36.164072 32262 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:3369] Column family [default] (ID 0), log number is 232 I0809 19:38:36.164078 32262 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:3369] Column family [doris] (ID 1), log number is 232 I0809 19:38:36.164084 32262 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:3369] Column family [meta] (ID 2), log number is 232 I0809 19:38:36.164216 32262 olap_meta.cpp:68] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1691581116164211, "job": 1, "event": "recovery_started", "log_files": [234]} I0809 19:38:36.164230 32262 olap_meta.cpp:68] [Rocksdb] [db/db_impl_open.cc:551] Recovering log #234 mode 2 I0809 19:38:36.164363 32262 olap_meta.cpp:68] [Rocksdb] [db/version_set.cc:2847] Creating manifest 236 I0809 19:38:36.165621 32262 olap_meta.cpp:68] [Rocksdb] EVENT_LOG_v1 {"time_micros": 1691581116165615, "job": 1, "event": "recovery_finished"} I0809 19:38:36.173629 32262 olap_meta.cpp:68] [Rocksdb] [db/db_impl_open.cc:1219] DB pointer 0x7fff97283000 I0809 19:38:36.173763 109959 storage_engine.cpp:256] stream load record path: /home/hadoop/xingying01/doris/storage I0809 19:38:36.190225 32414 data_dir.cpp:359] start to load tablets from /home/hadoop/xingying01/doris/storage I0809 19:38:36.190482 32414 data_dir.cpp:352] successfully check incompatible old format meta /home/hadoop/xingying01/doris/storage I0809 19:38:36.190500 32414 data_dir.cpp:370] begin loading rowset from meta I0809 19:38:36.190542 32414 data_dir.cpp:392] load rowset from meta finished, data dir: /home/hadoop/xingying01/doris/storage I0809 19:38:36.190551 32414 data_dir.cpp:397] begin loading tablet from meta E0809 19:38:36.190873 32414 variable.cpp:179] Already exposed doris_cache_delete_bitmap_agg_cache' whose value is0' E0809 19:38:36.190904 32414 variable.cpp:179] Already exposed doris_cache_delete_bitmap_agg_cache_persecond' whose value is0' I0809 19:38:36.205900 32414 data_dir.cpp:443] load tablet from meta finished, loaded tablet: 28, error tablet: 0, path: /home/hadoop/xingying01/doris/storage I0809 19:38:36.206036 32414 data_dir.cpp:586] finish to load tablets from /home/hadoop/xingying01/doris/storage, total rowset meta: 0, invalid rowset num: 0 I0809 19:38:36.211483 109959 storage_engine.cpp:112] success to init storage engine. I0809 19:38:36.211892 109959 olap_server.cpp:99] unused rowset monitor thread started I0809 19:38:36.212313 109959 olap_server.cpp:105] garbage sweeper thread started I0809 19:38:36.212725 109959 olap_server.cpp:111] disk stat monitor thread started I0809 19:38:36.228258 109959 olap_server.cpp:148] compaction tasks producer thread started I0809 19:38:36.228317 32503 olap_server.cpp:541] try to start compaction producer process! I0809 19:38:36.228713 109959 olap_server.cpp:153] tablet replicas info update thread started I0809 19:38:36.228775 32504 olap_server.cpp:637] start to update replica infos! W0809 19:38:36.228844 32504 olap_server.cpp:654] Have not get FE Master heartbeat yet I0809 19:38:36.233476 109959 olap_server.cpp:171] tablet checkpoint tasks producer thread started I0809 19:38:36.233508 32519 olap_server.cpp:388] begin to produce tablet meta checkpoint tasks. I0809 19:38:36.234128 109959 olap_server.cpp:176] tablet path check thread started I0809 19:38:36.234319 32522 tablet_manager.cpp:1165] finish to do meta checkpoint on dir: /home/hadoop/xingying01/doris/storage, number: 0, cost(ms): 0 I0809 19:38:36.234660 109959 olap_server.cpp:182] fd cache clean thread started I0809 19:38:36.235157 32525 olap_server.cpp:370] try to perform path scan! I0809 19:38:36.235175 32525 data_dir.cpp:704] start to scan data dir path:/home/hadoop/xingying01/doris/storage I0809 19:38:36.235544 109959 olap_server.cpp:201] path scan/gc threads started. number:1 I0809 19:38:36.235592 32526 olap_server.cpp:349] try to start path gc thread! I0809 19:38:36.235606 32526 olap_server.cpp:352] try to perform path gc by tablet! I0809 19:38:36.237743 109959 olap_server.cpp:208] cooldown thread pool started I0809 19:38:36.238185 109959 olap_server.cpp:214] cooldown tasks producer thread started I0809 19:38:36.238358 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:38:36.238641 109959 olap_server.cpp:220] remove unused remote files thread started I0809 19:38:36.239099 109959 olap_server.cpp:226] cold data compaction producer thread started I0809 19:38:36.239562 109959 olap_server.cpp:232] cache file cleaner tasks producer thread started I0809 19:38:36.239607 32540 olap_server.cpp:1191] Begin to Clean cache files I0809 19:38:36.254495 109959 olap_server.cpp:243] async publish thread started I0809 19:38:36.254515 109959 olap_server.cpp:245] all storage engine's background threads are started. I0809 19:38:36.282155 109959 agent_server.cpp:138] Register user resource listener I0809 19:38:36.282277 109959 backend_service.cpp:99] Doris BackendService listening on 9061 I0809 19:38:36.283648 109959 thrift_server.cpp:375] ThriftServer 'backend' started on port: 9061 I0809 19:38:36.538327 109959 brpc_service.cpp:75] BRPC server bind to host: 0.0.0.0, port: 8061 I0809 19:38:36.768793 109959 server.cpp:1107] Server[doris::PInternalServiceImpl] is serving on port=8061. I0809 19:38:36.768823 109959 server.cpp:1110] Check out http://palcement:8061 in web browser. I0809 19:38:36.819790 109959 thrift_server.cpp:375] ThriftServer 'heartbeat' started on port: 9051 I0809 19:38:38.220160 32525 data_dir.cpp:775] scan data dir path: /home/hadoop/xingying01/doris/storage finished. path size: 53 I0809 19:38:38.220256 32526 data_dir.cpp:611] start to path gc by tablet schemahash. I0809 19:38:38.220623 32526 data_dir.cpp:649] finished one time path gc by tablet. I0809 19:38:38.220645 32526 olap_server.cpp:355] try to perform path gc by rowsetid! I0809 19:38:38.220652 32526 data_dir.cpp:660] start to path gc by rowsetid. I0809 19:38:38.221060 32526 data_dir.cpp:694] finished one time path gc by rowsetid. I0809 19:38:40.892099 38123 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:1, BE start time: 1691581116818 I0809 19:38:40.892146 38123 heartbeat_server.cpp:175] master change. new master host: palcement. port: 9021. epoch: 1 I0809 19:38:40.892159 38123 heartbeat_server.cpp:199] get token. token: 8f4766a4-bcf8-4a20-8164-656f06d8a0a6 I0809 19:38:40.892167 38123 heartbeat_server.cpp:221] Master FE is changed or restarted. report tablet and disk info immediately I0809 19:38:43.607225 32968 fragment_mgr.cpp:688] query_id: 26fa104d6ef347bb-be4c1c65af1e8018 coord_addr TNetworkAddress(hostname=palcement, port=9021) total fragment num on current host: 2 I0809 19:38:43.607306 32968 fragment_mgr.cpp:757] Register query/load memory tracker, query/load id: 26fa104d6ef347bb-be4c1c65af1e8018 limit: 2.00 GB I0809 19:38:43.607429 32968 pipeline_fragment_context.cpp:215] PipelineFragmentContext::prepare|query_id=TUniqueId(hi=2808575242378889147, lo=-4734377885217947624)|instance_id=TUniqueId(hi=2808575242378889147, lo=-4734377885217947622)|backend_num=0|pthread_id=140724931143424 I0809 19:38:43.608515 32968 pipeline_fragment_context.cpp:215] PipelineFragmentContext::prepare|query_id=TUniqueId(hi=2808575242378889147, lo=-4734377885217947624)|instance_id=TUniqueId(hi=2808575242378889147, lo=-4734377885217947623)|backend_num=1|pthread_id=140724931143424 I0809 19:38:51.954731 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 19:38:51.955847 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155973681152 I0809 19:38:51.956017 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:38:51.956245 32663 task_worker_pool.cpp:1004] successfully report DISK|host=palcement|port=9021 I0809 19:38:51.958451 32664 tablet_manager.cpp:911] find expired transactions for 0 tablets I0809 19:38:51.958856 32664 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 19:38:51.960004 32664 task_worker_pool.cpp:1004] successfully report TABLET|host=palcement|port=9021 I0809 19:39:31.518975 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:39:32.736383 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 19:39:58.925644 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 19:39:59.171558 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:40:00.396946 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 19:40:00.401788 32664 tablet_manager.cpp:911] find expired transactions for 0 tablets I0809 19:40:00.402144 32664 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 19:40:00.402510 32664 task_worker_pool.cpp:1004] successfully report TABLET|host=palcement|port=9021 I0809 19:40:05.913511 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155972296704 I0809 19:40:05.913678 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:40:28.204756 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:40:30.167906 14406 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 19:41:19.812156 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 19:41:20.043633 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:41:20.259380 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 19:41:21.261556 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155970932736 I0809 19:41:21.261714 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:41:21.262027 32663 task_worker_pool.cpp:1004] successfully report DISK|host=palcement|port=9021 I0809 19:41:26.401217 32664 tablet_manager.cpp:911] find expired transactions for 0 tablets I0809 19:41:26.401590 32664 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 19:41:26.402065 32664 task_worker_pool.cpp:1004] successfully report TABLET|host=palcement|port=9021 I0809 19:41:28.194062 70149 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:13, BE start time: 1691581116818 I0809 19:42:22.146626 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 19:42:22.241873 32450 storage_engine.cpp:633] start trash and snapshot sweep. I0809 19:42:22.242115 32450 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:42:22.242156 32450 storage_engine.cpp:657] Start to sweep path /home/hadoop/xingying01/doris/storage I0809 19:42:22.395114 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:42:23.242758 32450 storage_engine.cpp:771] remove 0 invalid rowset meta from dir: /home/hadoop/xingying01/doris/storage I0809 19:42:23.242846 32450 storage_engine.cpp:796] removed invalid delete bitmap from dir: /home/hadoop/xingying01/doris/storage, deleted tablets size: 0 I0809 19:42:23.242888 32450 storage_engine.cpp:820] removed invalid pending publish info from dir: /home/hadoop/xingying01/doris/storage, deleted pending publish info size: 0 I0809 19:50:01.102138 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 19:50:01.191814 32450 storage_engine.cpp:633] start trash and snapshot sweep. I0809 19:50:01.191963 32450 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:50:01.191989 32450 storage_engine.cpp:657] Start to sweep path /home/hadoop/xingying01/doris/storage I0809 19:50:01.320799 32519 olap_server.cpp:388] begin to produce tablet meta checkpoint tasks. I0809 19:50:01.343421 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:50:01.563088 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 19:50:01.565181 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155959795712 I0809 19:50:01.565332 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:50:01.565553 32663 task_worker_pool.cpp:1004] successfully report DISK|host=palcement|port=9021 I0809 19:50:02.192427 32450 storage_engine.cpp:771] remove 0 invalid rowset meta from dir: /home/hadoop/xingying01/doris/storage I0809 19:50:02.192489 32450 storage_engine.cpp:796] removed invalid delete bitmap from dir: /home/hadoop/xingying01/doris/storage, deleted tablets size: 0 I0809 19:50:02.192524 32450 storage_engine.cpp:820] removed invalid pending publish info from dir: /home/hadoop/xingying01/doris/storage, deleted pending publish info size: 0 I0809 19:50:03.331908 129301 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 19:50:03.339680 67172 tablet_manager.cpp:1165] finish to do meta checkpoint on dir: /home/hadoop/xingying01/doris/storage, number: 0, cost(ms): 0 I0809 19:55:50.878324 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 19:55:50.968026 32450 storage_engine.cpp:633] start trash and snapshot sweep. I0809 19:55:50.968183 32450 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:55:50.968210 32450 storage_engine.cpp:657] Start to sweep path /home/hadoop/xingying01/doris/storage I0809 19:55:51.115056 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:55:51.341024 32664 tablet_manager.cpp:911] find expired transactions for 0 tablets I0809 19:55:51.341388 32664 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 19:55:51.341977 32664 task_worker_pool.cpp:1004] successfully report TABLET|host=palcement|port=9021 I0809 19:55:51.968660 32450 storage_engine.cpp:771] remove 0 invalid rowset meta from dir: /home/hadoop/xingying01/doris/storage I0809 19:55:51.968722 32450 storage_engine.cpp:796] removed invalid delete bitmap from dir: /home/hadoop/xingying01/doris/storage, deleted tablets size: 0 I0809 19:55:51.968756 32450 storage_engine.cpp:820] removed invalid pending publish info from dir: /home/hadoop/xingying01/doris/storage, deleted pending publish info size: 0 I0809 19:55:52.338487 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155952357376 I0809 19:55:52.338649 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:55:52.339012 32663 task_worker_pool.cpp:1004] successfully report DISK|host=palcement|port=9021 I0809 19:55:53.113345 25237 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 19:56:05.593700 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 19:56:07.386821 25250 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 19:58:18.107415 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 19:58:18.344368 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:58:20.331065 45247 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:25, BE start time: 1691581116818 I0809 19:58:20.331166 45244 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 19:58:25.318517 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 19:58:25.320672 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155949531136 I0809 19:58:25.320817 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:58:25.321023 32663 task_worker_pool.cpp:1004] successfully report DISK|host=palcement|port=9021 I0809 19:58:25.323244 32664 tablet_manager.cpp:911] find expired transactions for 0 tablets I0809 19:58:25.323590 32664 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 19:58:25.323913 32664 task_worker_pool.cpp:1004] successfully report TABLET|host=palcement|port=9021 I0809 19:58:27.095074 45275 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 19:58:33.510083 58068 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 19:58:33.616986 58169 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:37, BE start time: 1691581116818 I0809 19:58:45.849067 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 19:58:51.920667 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 19:58:51.968873 32450 storage_engine.cpp:633] start trash and snapshot sweep. I0809 19:58:51.969028 32450 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 19:58:51.969055 32450 storage_engine.cpp:657] Start to sweep path /home/hadoop/xingying01/doris/storage I0809 19:58:52.969509 32450 storage_engine.cpp:771] remove 0 invalid rowset meta from dir: /home/hadoop/xingying01/doris/storage I0809 19:58:52.969581 32450 storage_engine.cpp:796] removed invalid delete bitmap from dir: /home/hadoop/xingying01/doris/storage, deleted tablets size: 0 I0809 19:58:52.969624 32450 storage_engine.cpp:820] removed invalid pending publish info from dir: /home/hadoop/xingying01/doris/storage, deleted pending publish info size: 0 I0809 19:58:53.709720 78820 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:49, BE start time: 1691581116818 I0809 20:00:20.594465 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 20:00:20.815810 32519 olap_server.cpp:388] begin to produce tablet meta checkpoint tasks. I0809 20:00:20.838361 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 20:00:22.892202 35839 tablet_manager.cpp:1165] finish to do meta checkpoint on dir: /home/hadoop/xingying01/doris/storage, number: 0, cost(ms): 0 I0809 20:01:03.594357 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 20:01:03.817361 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 20:01:03.819518 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155941740544 I0809 20:01:03.819667 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 20:01:03.819859 32663 task_worker_pool.cpp:1004] successfully report DISK|host=palcement|port=9021 I0809 20:01:03.822103 32664 tablet_manager.cpp:911] find expired transactions for 0 tablets I0809 20:01:03.822397 32664 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 20:01:03.822710 32664 task_worker_pool.cpp:1004] successfully report TABLET|host=palcement|port=9021 I0809 20:01:05.645087 36147 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:04:10.740104 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 20:04:10.831463 32450 storage_engine.cpp:633] start trash and snapshot sweep. I0809 20:04:10.831621 32450 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 20:04:10.831648 32450 storage_engine.cpp:657] Start to sweep path /home/hadoop/xingying01/doris/storage I0809 20:04:10.979447 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 20:04:11.832087 32450 storage_engine.cpp:771] remove 0 invalid rowset meta from dir: /home/hadoop/xingying01/doris/storage I0809 20:04:11.832149 32450 storage_engine.cpp:796] removed invalid delete bitmap from dir: /home/hadoop/xingying01/doris/storage, deleted tablets size: 0 I0809 20:04:11.832183 32450 storage_engine.cpp:820] removed invalid pending publish info from dir: /home/hadoop/xingying01/doris/storage, deleted pending publish info size: 0 I0809 20:04:12.197714 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 20:04:12.202505 32664 tablet_manager.cpp:911] find expired transactions for 0 tablets I0809 20:04:12.202816 32664 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 20:04:12.203150 32664 task_worker_pool.cpp:1004] successfully report TABLET|host=palcement|port=9021 I0809 20:04:12.976163 5385 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:04:16.546875 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155937845248 I0809 20:04:16.547029 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 20:04:16.547453 32663 task_worker_pool.cpp:1004] successfully report DISK|host=palcement|port=9021 I0809 20:04:18.342566 10705 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:61, BE start time: 1691581116818 W0809 20:42:10.525032 31668 file_system.cpp:72] [IO_ERROR]failed to list /home/hadoop/xingying01/doris/storage/mini_download: (2), No such file or directory I0809 20:42:11.019701 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 20:42:11.110219 32450 storage_engine.cpp:633] start trash and snapshot sweep. I0809 20:42:11.110381 32450 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 20:42:11.110410 32450 storage_engine.cpp:657] Start to sweep path /home/hadoop/xingying01/doris/storage I0809 20:42:11.239575 32519 olap_server.cpp:388] begin to produce tablet meta checkpoint tasks. I0809 20:42:11.262331 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 20:42:12.110841 32450 storage_engine.cpp:771] remove 0 invalid rowset meta from dir: /home/hadoop/xingying01/doris/storage I0809 20:42:12.110900 32450 storage_engine.cpp:796] removed invalid delete bitmap from dir: /home/hadoop/xingying01/doris/storage, deleted tablets size: 0 I0809 20:42:12.110934 32450 storage_engine.cpp:820] removed invalid pending publish info from dir: /home/hadoop/xingying01/doris/storage, deleted pending publish info size: 0 I0809 20:42:13.245002 65938 tablet_manager.cpp:1165] finish to do meta checkpoint on dir: /home/hadoop/xingying01/doris/storage, number: 0, cost(ms): 0 I0809 20:42:13.250414 67944 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:42:16.757324 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 20:42:16.759382 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155885940736 I0809 20:42:16.759531 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 20:42:16.759757 32663 task_worker_pool.cpp:1004] successfully report DISK|host=palcement|port=9021 I0809 20:42:16.762017 32664 tablet_manager.cpp:911] find expired transactions for 0 tablets I0809 20:42:16.762303 32664 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 20:42:16.762627 32664 task_worker_pool.cpp:1004] successfully report TABLET|host=palcement|port=9021 I0809 20:42:18.565568 73201 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:42:57.619776 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 20:42:59.634567 112881 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:43:03.054351 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 20:43:04.846388 118224 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:43:10.911528 124168 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:73, BE start time: 1691581116818 I0809 20:43:10.917064 124176 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 W0809 20:43:10.917870 30780 local_file_system.cpp:298] [IO_ERROR]failed to list /proc/109959/fd/: (2), No such file or directory W0809 20:43:10.917915 30780 doris_metrics.cpp:379] failed to count fd: [IO_ERROR]failed to list /proc/109959/fd/: (2), No such file or directory I0809 20:43:14.353411 31983 load_channel_mgr.cpp:233] cleaning timed out load channels I0809 20:43:16.614358 129947 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:43:19.277873 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 20:43:19.817555 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 20:43:24.048830 32663 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 155884650496 I0809 20:43:24.048982 32663 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28 I0809 20:43:24.049342 32663 task_worker_pool.cpp:1004] successfully report DISK|host=palcement|port=9021 I0809 20:43:24.051373 32664 tablet_manager.cpp:911] find expired transactions for 0 tablets I0809 20:43:24.051656 32664 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28 I0809 20:43:24.051965 32664 task_worker_pool.cpp:1004] successfully report TABLET|host=palcement|port=9021 I0809 20:43:25.797174 3937 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 Signal: SIGSEGV (Segmentation fault) Query id: 26fa104d6ef347bb-be4c1c65af1e8018 Aborted at 1691585017 (unix time) try "date -d @1691585017" if you are using GNU date Current BE git commitID: d5d82b7 SIGSEGV invalid permissions for mapped object (@0x7fff43cf6b00) received by PID 109959 (TID 32968 OR 0x7ffd13882700) from PID 1137666816; stack trace: I0809 20:43:38.211149 32661 task_worker_pool.cpp:1004] successfully report TASK|host=palcement|port=9021 I0809 20:43:38.951047 21519 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:43:38.955150 21526 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:85, BE start time: 1691581116818 I0809 20:43:38.957373 21531 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:43:38.961632 21539 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:43:38.967869 21551 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:43:38.972072 21559 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:43:38.978525 21571 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1 I0809 20:43:38.980556 21574 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:97, BE start time: 1691581116818 I0809 20:43:38.996228 21603 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:109, BE start time: 1691581116818 I0809 20:43:39.011780 21630 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:121, BE start time: 1691581116818 I0809 20:43:39.027386 21657 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:133, BE start time: 1691581116818 I0809 20:43:39.042934 21683 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:145, BE start time: 1691581116818 I0809 20:43:39.058393 21709 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:157, BE start time: 1691581116818 I0809 20:43:39.073987 21737 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:169, BE start time: 1691581116818 I0809 20:43:39.089368 21763 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:181, BE start time: 1691581116818 I0809 20:43:39.104746 21792 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:193, BE start time: 1691581116818 I0809 20:43:39.120177 21818 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:205, BE start time: 1691581116818 I0809 20:43:39.135486 21849 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:217, BE start time: 1691581116818 I0809 20:43:39.150797 21876 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:229, BE start time: 1691581116818 I0809 20:43:39.166160 21909 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:241, BE start time: 1691581116818 I0809 20:43:39.181674 21939 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:253, BE start time: 1691581116818 I0809 20:43:39.196961 21967 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:265, BE start time: 1691581116818 I0809 20:43:39.212349 21994 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:277, BE start time: 1691581116818 I0809 20:43:39.227658 22020 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:289, BE start time: 1691581116818 I0809 20:43:39.243083 22047 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:301, BE start time: 1691581116818 I0809 20:43:39.258503 22074 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:313, BE start time: 1691581116818 I0809 20:43:39.273905 22102 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:325, BE start time: 1691581116818 I0809 20:43:39.278012 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0 I0809 20:43:39.289304 22130 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:337, BE start time: 1691581116818 I0809 20:43:39.304556 22156 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:349, BE start time: 1691581116818 I0809 20:43:39.319933 22183 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:361, BE start time: 1691581116818 I0809 20:43:39.335347 22210 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:373, BE start time: 1691581116818 I0809 20:43:39.350713 22238 heartbeat_server.cpp:61] get heartbeat from FE.host:palcement, port:9021, cluster id:1477139465, counter:385, BE start time: 1691581116818 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t, void) at /home/hadoop/xingying01/doris/be/src/common/signal_handler.h:413 1# os::Linux::chained_handler(int, siginfo, void) in /home/hadoop/impala/packages/jdk1.8.0_152/jre/lib/amd64/server/libjvm.so 2# JVM_handle_linux_signal in /home/hadoop/impala/packages/jdk1.8.0_152/jre/lib/amd64/server/libjvm.so 3# signalHandler(int, siginfo, void) in /home/hadoop/impala/packages/jdk1.8.0_152/jre/lib/amd64/server/libjvm.so 4# 0x00007FFFF7621400 in /lib64/libc.so.6 5# 0x00007FFF43CF6B00

Signal: SIGSEGV (Segmentation fault) I0809 20:43:59.278192 32535 olap_server.cpp:1039] cooldown producer get tablet num: 0

Process finished with exit code -1

xingyingone commented 1 year ago

我的debug过程中，先是：

image

然后运行到

image

gdb 看堆栈

image

SQL

CREATE TABLE test_map_agg_alex1 ( id int(11) NOT NULL, label_name varchar(32) NOT NULL, value_field string NOT NULL, ) ENGINE=OLAP DUPLICATE KEY(id) COMMENT 'OLAP' DISTRIBUTED BY HASH(id) BUCKETS 1 PROPERTIES ( "replication_allocation" = "tag.location.default: 1", "storage_format" = "V2", "light_schema_change" = "true", "disable_auto_compaction" = "false", "enable_single_replica_compaction" = "false" );

            insert into `test_map_agg_alex1` values
        (1, "LA", "V1_1"),
        (1, "LB", "V1_2"),
        (1, "LC", "V1_3"),
        (2, "LA", "V2_1"),
        (2, "LB", "V2_2"),
        (2, "LC", "V2_3"),
        (3, "LA", "V3_1"),
        (3, "LB", "V3_2"),
        (3, "LC", "V3_3"),
        (4, "LA", "V4_1"),
        (4, "LB", "V4_2"),
        (4, "LC", "V4_3"),
        (5, "LA", "V5_1"),
        (5, "LB", "V5_2"),
        (5, "LC", "V5_3");

SELECT id, map_agg(label_name,value_field) FROM test_map_agg_alex1 GROUP BY id;

日志

I0810 10:40:09.311506 13712 olap_server.cpp:1039] cooldown producer get tablet num: 0
I0810 10:40:09.522622 13835 task_worker_pool.cpp:1004] successfully report TASK|host=repalcement|port=9021
I0810 10:40:09.524763 13837 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 154086383616
I0810 10:40:09.524899 13837 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28
I0810 10:40:09.525162 13837 task_worker_pool.cpp:1004] successfully report DISK|host=repalcement|port=9021
I0810 10:40:09.527266 13839 tablet_manager.cpp:911] find expired transactions for 0 tablets
I0810 10:40:09.527557 13839 tablet_manager.cpp:943] success to build all report tablets info. tablet_count=28
I0810 10:40:09.528723 13839 task_worker_pool.cpp:1004] successfully report TABLET|host=repalcement|port=9021
I0810 10:40:10.169128 13625 storage_engine.cpp:771] remove 0 invalid rowset meta from dir: /home/hadoop/xingying01/doris/storage
I0810 10:40:10.169199 13625 storage_engine.cpp:796] removed invalid delete bitmap from dir: /home/hadoop/xingying01/doris/storage, deleted tablets size: 0
I0810 10:40:10.169245 13625 storage_engine.cpp:820] removed invalid pending publish info from dir: /home/hadoop/xingying01/doris/storage, deleted pending publish info size: 0
I0810 10:40:11.236510 17435 backend_service.cpp:360] get_batch stream_load_record rocksdb successfully. records size: 0, last_stream_load_timestamp: -1
I0810 10:40:14.284767 13161 load_channel_mgr.cpp:233] cleaning timed out load channels
I0810 10:40:23.779556 13835 task_worker_pool.cpp:1004] successfully report TASK|host=repalcement|port=9021
Signal: SIGSEGV (Segmentation fault)
I0810 10:40:46.066476 13696 olap_server.cpp:388] begin to produce tablet meta checkpoint tasks.
I0810 10:40:46.089054 13712 olap_server.cpp:1039] cooldown producer get tablet num: 0
*** Query id: a7c9b2b224e54a26-aeaf940c94efbdc8 ***
*** Aborted at 1691635246 (unix time) try "date -d @1691635246" if you are using GNU date ***
*** Current BE git commitID: d5d82b7 ***
*** SIGSEGV invalid permissions for mapped object (@0x7fff436f5b00) received by PID 76760 (TID 14138 OR 0x7ffd15482700) from PID 1131371264; stack trace: ***
I0810 10:40:48.061192 109503 tablet_manager.cpp:1165] finish to do meta checkpoint on dir: /home/hadoop/xingying01/doris/storage, number: 0, cost(ms): 0
I0810 10:40:48.062433 111486 heartbeat_server.cpp:61] get heartbeat from FE.host:repalcement, port:9021, cluster id:1477139465, counter:49, BE start time: 1691634634697
I0810 10:40:48.077497 111512 heartbeat_server.cpp:61] get heartbeat from FE.host:repalcement, port:9021, cluster id:1477139465, counter:61, BE start time: 1691634634697
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/hadoop/xingying01/doris/be/src/common/signal_handler.h:413
 1# os::Linux::chained_handler(int, siginfo*, void*) in /home/hadoop/impala/packages/jdk1.8.0_152/jre/lib/amd64/server/libjvm.so
 2# JVM_handle_linux_signal in /home/hadoop/impala/packages/jdk1.8.0_152/jre/lib/amd64/server/libjvm.so
 3# signalHandler(int, siginfo*, void*) in /home/hadoop/impala/packages/jdk1.8.0_152/jre/lib/amd64/server/libjvm.so
 4# 0x00007FFFF7621400 in /lib64/libc.so.6
 5# 0x00007FFF436F5B00

Signal: SIGSEGV (Segmentation fault)
I0810 10:41:14.284886 13161 load_channel_mgr.cpp:233] cleaning timed out load channels
I0810 10:41:14.334689 13712 olap_server.cpp:1039] cooldown producer get tablet num: 0
I0810 10:41:14.557178 13835 task_worker_pool.cpp:1004] successfully report TASK|host=repalcement|port=9021
I0810 10:41:15.559481 13837 data_dir.cpp:807] path: /home/hadoop/xingying01/doris/storage total capacity: 1045390315520, available capacity: 154085048320
I0810 10:41:15.559640 13837 storage_engine.cpp:373] get root path info cost: 0 ms. tablet counter: 28
I0810 10:41:15.560007 13837 task_worker_pool.cpp:1004] successfully report DISK|host=repalcement|port=9021
Signal: SIGSEGV (Segmentation fault)

Process finished with exit code -1
xingyingone commented 1 year ago

好像有循环调用

image