search

dnanexus-rnd / GLnexus

Scalable gVCF merging and joint variant calling for population sequencing projects
Apache License 2.0
142 stars 37 forks source link

Error vcf exists check log #220

Open ghost opened 4 years ago

ghost commented 4 years ago

Hello, I am getting this error

[12907] [2020-05-22 13:22:59.879] [GLnexus] [error] ARC_D30.g.vcf.gz Exists: sample is currently being added (default (ARC_D30.g.vcf.gz))
[12907] [2020-05-22 13:23:04.756] [GLnexus] [error] Failed to bulk load into DB: Failure: One or more gVCF inputs failed validation or database loading; check log for details.
Failed to read from standard input: unknown file type

I have no idea of what might be wrong, the vcf file looks all right to me. here is the vcf header

##fileformat=VCFv4.2
##FILTER=<ID=PASS,Description="All filters passed">
##FILTER=<ID=RefCall,Description="Genotyping model thinks this site is reference.">
##FILTER=<ID=LowQual,Description="Confidence in this variant being real is below calling threshold.">
##INFO=<ID=END,Number=1,Type=Integer,Description="End position (for use with symbolic alleles)">
##FORMAT=<ID=GT,Number=1,Type=String,Description="Genotype">
##FORMAT=<ID=GQ,Number=1,Type=Integer,Description="Conditional genotype quality">
##FORMAT=<ID=DP,Number=1,Type=Integer,Description="Read depth">
##FORMAT=<ID=MIN_DP,Number=1,Type=Integer,Description="Minimum DP observed within the GVCF block.">
##FORMAT=<ID=AD,Number=R,Type=Integer,Description="Read depth for each allele">
##FORMAT=<ID=VAF,Number=A,Type=Float,Description="Variant allele fractions.">
##FORMAT=<ID=PL,Number=G,Type=Integer,Description="Phred-scaled genotype likelihoods rounded to the closest integer">
##contig=<ID=Chrom_3,length=20354777>
##contig=<ID=Chrom_1,length=18146847>
##contig=<ID=Chrom_5,length=16930519>
##contig=<ID=Chrom_2,length=16274841>
##contig=<ID=Chrom_4,length=15224634>
##contig=<ID=Chrom_6,length=13893210>
##bcftools_viewVersion=1.10.2-27-g9d66868+htslib-1.10.2-32-g84f0a86
##bcftools_viewCommand=view ARC_D30.g.vcf.gz; Date=Fri May 22 13:26:43 2020
#CHROM  POS ID  REF ALT QUAL    FILTER  INFO    FORMAT  default

thank you

PS: here is the log

2020/05/22-13:22:50.554608 7f33fc5e8f00 RocksDB version: 6.6.4
2020/05/22-13:22:50.554641 7f33fc5e8f00 Git sha rocksdb_build_git_sha:4d057dcf24b68b33de7a9759ae65ca2b144a3d47
2020/05/22-13:22:50.554643 7f33fc5e8f00 Compile date Mar 19 2020
2020/05/22-13:22:50.554644 7f33fc5e8f00 DB SUMMARY
2020/05/22-13:22:50.554668 7f33fc5e8f00 CURRENT file:  CURRENT
2020/05/22-13:22:50.554669 7f33fc5e8f00 IDENTITY file:  IDENTITY
2020/05/22-13:22:50.554672 7f33fc5e8f00 MANIFEST file:  MANIFEST-000006 size: 452 Bytes
2020/05/22-13:22:50.554674 7f33fc5e8f00 SST files in GLnexus.DB dir, Total Num: 2, files: 000018.sst 000019.sst 
2020/05/22-13:22:50.554675 7f33fc5e8f00 Write Ahead Log file in GLnexus.DB: 000017.log size: 0 ; 
2020/05/22-13:22:50.554676 7f33fc5e8f00                         Options.error_if_exists: 0
2020/05/22-13:22:50.554677 7f33fc5e8f00                       Options.create_if_missing: 0
2020/05/22-13:22:50.554678 7f33fc5e8f00                         Options.paranoid_checks: 1
2020/05/22-13:22:50.554679 7f33fc5e8f00                                     Options.env: 0x5638c74ce580
2020/05/22-13:22:50.554680 7f33fc5e8f00                                Options.info_log: 0x5638c8d7f090
2020/05/22-13:22:50.554680 7f33fc5e8f00                Options.max_file_opening_threads: 16
2020/05/22-13:22:50.554681 7f33fc5e8f00                              Options.statistics: (nil)
2020/05/22-13:22:50.554682 7f33fc5e8f00                               Options.use_fsync: 0
2020/05/22-13:22:50.554683 7f33fc5e8f00                       Options.max_log_file_size: 0
2020/05/22-13:22:50.554684 7f33fc5e8f00                  Options.max_manifest_file_size: 1073741824
2020/05/22-13:22:50.554685 7f33fc5e8f00                   Options.log_file_time_to_roll: 0
2020/05/22-13:22:50.554686 7f33fc5e8f00                       Options.keep_log_file_num: 1000
2020/05/22-13:22:50.554686 7f33fc5e8f00                    Options.recycle_log_file_num: 0
2020/05/22-13:22:50.554687 7f33fc5e8f00                         Options.allow_fallocate: 1
2020/05/22-13:22:50.554688 7f33fc5e8f00                        Options.allow_mmap_reads: 0
2020/05/22-13:22:50.554689 7f33fc5e8f00                       Options.allow_mmap_writes: 0
2020/05/22-13:22:50.554690 7f33fc5e8f00                        Options.use_direct_reads: 0
2020/05/22-13:22:50.554690 7f33fc5e8f00                        Options.use_direct_io_for_flush_and_compaction: 0
2020/05/22-13:22:50.554691 7f33fc5e8f00          Options.create_missing_column_families: 0
2020/05/22-13:22:50.554692 7f33fc5e8f00                              Options.db_log_dir: 
2020/05/22-13:22:50.554693 7f33fc5e8f00                                 Options.wal_dir: GLnexus.DB
2020/05/22-13:22:50.554694 7f33fc5e8f00                Options.table_cache_numshardbits: 6
2020/05/22-13:22:50.554694 7f33fc5e8f00                      Options.max_subcompactions: 8
2020/05/22-13:22:50.554695 7f33fc5e8f00                  Options.max_background_flushes: -1
2020/05/22-13:22:50.554696 7f33fc5e8f00                         Options.WAL_ttl_seconds: 0
2020/05/22-13:22:50.554697 7f33fc5e8f00                       Options.WAL_size_limit_MB: 0
2020/05/22-13:22:50.554698 7f33fc5e8f00                        Options.max_write_batch_group_size_bytes: 1048576
2020/05/22-13:22:50.554698 7f33fc5e8f00             Options.manifest_preallocation_size: 4194304
2020/05/22-13:22:50.554699 7f33fc5e8f00                     Options.is_fd_close_on_exec: 1
2020/05/22-13:22:50.554700 7f33fc5e8f00                   Options.advise_random_on_open: 1
2020/05/22-13:22:50.554701 7f33fc5e8f00                    Options.db_write_buffer_size: 0
2020/05/22-13:22:50.554702 7f33fc5e8f00                    Options.write_buffer_manager: 0x5638c8e080e0
2020/05/22-13:22:50.554703 7f33fc5e8f00         Options.access_hint_on_compaction_start: 2
2020/05/22-13:22:50.554703 7f33fc5e8f00  Options.new_table_reader_for_compaction_inputs: 1
2020/05/22-13:22:50.554704 7f33fc5e8f00           Options.random_access_max_buffer_size: 1048576
2020/05/22-13:22:50.554705 7f33fc5e8f00                      Options.use_adaptive_mutex: 0
2020/05/22-13:22:50.554706 7f33fc5e8f00                            Options.rate_limiter: (nil)
2020/05/22-13:22:50.554715 7f33fc5e8f00     Options.sst_file_manager.rate_bytes_per_sec: 0
2020/05/22-13:22:50.554716 7f33fc5e8f00                       Options.wal_recovery_mode: 2
2020/05/22-13:22:50.554717 7f33fc5e8f00                  Options.enable_thread_tracking: 0
2020/05/22-13:22:50.554717 7f33fc5e8f00                  Options.enable_pipelined_write: 0
2020/05/22-13:22:50.554718 7f33fc5e8f00                  Options.unordered_write: 0
2020/05/22-13:22:50.554719 7f33fc5e8f00         Options.allow_concurrent_memtable_write: 0
2020/05/22-13:22:50.554720 7f33fc5e8f00      Options.enable_write_thread_adaptive_yield: 1
2020/05/22-13:22:50.554721 7f33fc5e8f00             Options.write_thread_max_yield_usec: 100
2020/05/22-13:22:50.554721 7f33fc5e8f00            Options.write_thread_slow_yield_usec: 3
2020/05/22-13:22:50.554722 7f33fc5e8f00                               Options.row_cache: None
2020/05/22-13:22:50.554723 7f33fc5e8f00                              Options.wal_filter: None
2020/05/22-13:22:50.554724 7f33fc5e8f00             Options.avoid_flush_during_recovery: 0
2020/05/22-13:22:50.554725 7f33fc5e8f00             Options.allow_ingest_behind: 0
2020/05/22-13:22:50.554725 7f33fc5e8f00             Options.preserve_deletes: 0
2020/05/22-13:22:50.554726 7f33fc5e8f00             Options.two_write_queues: 0
2020/05/22-13:22:50.554727 7f33fc5e8f00             Options.manual_wal_flush: 0
2020/05/22-13:22:50.554728 7f33fc5e8f00             Options.atomic_flush: 0
2020/05/22-13:22:50.554728 7f33fc5e8f00             Options.avoid_unnecessary_blocking_io: 0
2020/05/22-13:22:50.554729 7f33fc5e8f00                 Options.persist_stats_to_disk: 0
2020/05/22-13:22:50.554730 7f33fc5e8f00                 Options.write_dbid_to_manifest: 0
2020/05/22-13:22:50.554731 7f33fc5e8f00                 Options.log_readahead_size: 0
2020/05/22-13:22:50.554731 7f33fc5e8f00             Options.max_background_jobs: 8
2020/05/22-13:22:50.554732 7f33fc5e8f00             Options.max_background_compactions: -1
2020/05/22-13:22:50.554733 7f33fc5e8f00             Options.avoid_flush_during_shutdown: 0
2020/05/22-13:22:50.554734 7f33fc5e8f00           Options.writable_file_max_buffer_size: 1048576
2020/05/22-13:22:50.554735 7f33fc5e8f00             Options.delayed_write_rate : 10737418240
2020/05/22-13:22:50.554735 7f33fc5e8f00             Options.max_total_wal_size: 0
2020/05/22-13:22:50.554736 7f33fc5e8f00             Options.delete_obsolete_files_period_micros: 900000000
2020/05/22-13:22:50.554737 7f33fc5e8f00                   Options.stats_dump_period_sec: 600
2020/05/22-13:22:50.554738 7f33fc5e8f00                 Options.stats_persist_period_sec: 600
2020/05/22-13:22:50.554739 7f33fc5e8f00                 Options.stats_history_buffer_size: 1048576
2020/05/22-13:22:50.554740 7f33fc5e8f00                          Options.max_open_files: -1
2020/05/22-13:22:50.554740 7f33fc5e8f00                          Options.bytes_per_sync: 0
2020/05/22-13:22:50.554741 7f33fc5e8f00                      Options.wal_bytes_per_sync: 0
2020/05/22-13:22:50.554742 7f33fc5e8f00                   Options.strict_bytes_per_sync: 0
2020/05/22-13:22:50.554743 7f33fc5e8f00       Options.compaction_readahead_size: 16777216
2020/05/22-13:22:50.554743 7f33fc5e8f00 Compression algorithms supported:
2020/05/22-13:22:50.554745 7f33fc5e8f00     kZSTDNotFinalCompression supported: 1
2020/05/22-13:22:50.554746 7f33fc5e8f00     kZSTD supported: 1
2020/05/22-13:22:50.554747 7f33fc5e8f00     kXpressCompression supported: 0
2020/05/22-13:22:50.554748 7f33fc5e8f00     kLZ4HCCompression supported: 0
2020/05/22-13:22:50.554749 7f33fc5e8f00     kLZ4Compression supported: 0
2020/05/22-13:22:50.554750 7f33fc5e8f00     kBZip2Compression supported: 1
2020/05/22-13:22:50.554751 7f33fc5e8f00     kZlibCompression supported: 1
2020/05/22-13:22:50.554751 7f33fc5e8f00     kSnappyCompression supported: 1
2020/05/22-13:22:50.554753 7f33fc5e8f00 Fast CRC32 supported: Supported on x86
2020/05/22-13:22:50.554879 7f33fc5e8f00 [rsion_set.cc:4377] Recovering from manifest file: GLnexus.DB/MANIFEST-000006
2020/05/22-13:22:50.554944 7f33fc5e8f00 [lumn_family.cc:550] --------------- Options for column family [default]:
2020/05/22-13:22:50.554946 7f33fc5e8f00               Options.comparator: leveldb.BytewiseComparator
2020/05/22-13:22:50.554947 7f33fc5e8f00           Options.merge_operator: None
2020/05/22-13:22:50.554948 7f33fc5e8f00        Options.compaction_filter: None
2020/05/22-13:22:50.554949 7f33fc5e8f00        Options.compaction_filter_factory: None
2020/05/22-13:22:50.554949 7f33fc5e8f00         Options.memtable_factory: VectorRepFactory
2020/05/22-13:22:50.554950 7f33fc5e8f00            Options.table_factory: BlockBasedTable
2020/05/22-13:22:50.554968 7f33fc5e8f00            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5638c8db05a0)
  cache_index_and_filter_blocks: 1
  cache_index_and_filter_blocks_with_high_priority: 1
  pin_l0_filter_and_index_blocks_in_cache: 0
  pin_top_level_index_and_filter: 1
  index_type: 0
  data_block_index_type: 0
  index_shortening: 1
  data_block_hash_table_util_ratio: 0.750000
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x5638c8dea9d0
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 13473801830
    num_shard_bits : 6
    strict_capacity_limit : 0
    memory_allocator : None
    high_pri_pool_ratio: 0.500
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 1048576
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 4
  enable_index_compression: 1
  block_align: 0
2020/05/22-13:22:50.554969 7f33fc5e8f00        Options.write_buffer_size: 8982534553
2020/05/22-13:22:50.554970 7f33fc5e8f00  Options.max_write_buffer_number: 4
2020/05/22-13:22:50.554971 7f33fc5e8f00          Options.compression: ZSTD
2020/05/22-13:22:50.554972 7f33fc5e8f00                  Options.bottommost_compression: Disabled
2020/05/22-13:22:50.554973 7f33fc5e8f00       Options.prefix_extractor: nullptr
2020/05/22-13:22:50.554974 7f33fc5e8f00   Options.memtable_insert_with_hint_prefix_extractor: nullptr
2020/05/22-13:22:50.554975 7f33fc5e8f00             Options.num_levels: 4
2020/05/22-13:22:50.554976 7f33fc5e8f00        Options.min_write_buffer_number_to_merge: 1
2020/05/22-13:22:50.554977 7f33fc5e8f00     Options.max_write_buffer_number_to_maintain: 0
2020/05/22-13:22:50.554977 7f33fc5e8f00     Options.max_write_buffer_size_to_maintain: 0
2020/05/22-13:22:50.554978 7f33fc5e8f00            Options.bottommost_compression_opts.window_bits: -14
2020/05/22-13:22:50.554979 7f33fc5e8f00                  Options.bottommost_compression_opts.level: 32767
2020/05/22-13:22:50.554980 7f33fc5e8f00               Options.bottommost_compression_opts.strategy: 0
2020/05/22-13:22:50.554981 7f33fc5e8f00         Options.bottommost_compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.554982 7f33fc5e8f00         Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.554982 7f33fc5e8f00                  Options.bottommost_compression_opts.enabled: false
2020/05/22-13:22:50.554983 7f33fc5e8f00            Options.compression_opts.window_bits: -14
2020/05/22-13:22:50.554984 7f33fc5e8f00                  Options.compression_opts.level: 2
2020/05/22-13:22:50.554985 7f33fc5e8f00               Options.compression_opts.strategy: 0
2020/05/22-13:22:50.554986 7f33fc5e8f00         Options.compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.554986 7f33fc5e8f00         Options.compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.554987 7f33fc5e8f00                  Options.compression_opts.enabled: false
2020/05/22-13:22:50.554988 7f33fc5e8f00      Options.level0_file_num_compaction_trigger: 4
2020/05/22-13:22:50.554989 7f33fc5e8f00          Options.level0_slowdown_writes_trigger: 1073741824
2020/05/22-13:22:50.554990 7f33fc5e8f00              Options.level0_stop_writes_trigger: 1073741824
2020/05/22-13:22:50.554997 7f33fc5e8f00                   Options.target_file_size_base: 4294967296
2020/05/22-13:22:50.554998 7f33fc5e8f00             Options.target_file_size_multiplier: 1
2020/05/22-13:22:50.554999 7f33fc5e8f00                Options.max_bytes_for_level_base: 268435456
2020/05/22-13:22:50.555000 7f33fc5e8f00 Options.level_compaction_dynamic_level_bytes: 0
2020/05/22-13:22:50.555000 7f33fc5e8f00          Options.max_bytes_for_level_multiplier: 10.000000
2020/05/22-13:22:50.555002 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2020/05/22-13:22:50.555003 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2020/05/22-13:22:50.555004 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2020/05/22-13:22:50.555005 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2020/05/22-13:22:50.555006 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2020/05/22-13:22:50.555007 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2020/05/22-13:22:50.555007 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2020/05/22-13:22:50.555008 7f33fc5e8f00       Options.max_sequential_skip_in_iterations: 8
2020/05/22-13:22:50.555009 7f33fc5e8f00                    Options.max_compaction_bytes: 107374182400
2020/05/22-13:22:50.555010 7f33fc5e8f00                        Options.arena_block_size: 1122820096
2020/05/22-13:22:50.555011 7f33fc5e8f00   Options.soft_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555012 7f33fc5e8f00   Options.hard_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555012 7f33fc5e8f00       Options.rate_limit_delay_max_milliseconds: 100
2020/05/22-13:22:50.555013 7f33fc5e8f00                Options.disable_auto_compactions: 0
2020/05/22-13:22:50.555014 7f33fc5e8f00                        Options.compaction_style: kCompactionStyleUniversal
2020/05/22-13:22:50.555015 7f33fc5e8f00                          Options.compaction_pri: kMinOverlappingRatio
2020/05/22-13:22:50.555016 7f33fc5e8f00 Options.compaction_options_universal.size_ratio: 10
2020/05/22-13:22:50.555017 7f33fc5e8f00 Options.compaction_options_universal.min_merge_width: 2
2020/05/22-13:22:50.555018 7f33fc5e8f00 Options.compaction_options_universal.max_merge_width: 6
2020/05/22-13:22:50.555019 7f33fc5e8f00 Options.compaction_options_universal.max_size_amplification_percent: 1073741824
2020/05/22-13:22:50.555020 7f33fc5e8f00 Options.compaction_options_universal.compression_size_percent: -1
2020/05/22-13:22:50.555021 7f33fc5e8f00 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2020/05/22-13:22:50.555022 7f33fc5e8f00 Options.compaction_options_fifo.max_table_files_size: 1073741824
2020/05/22-13:22:50.555022 7f33fc5e8f00 Options.compaction_options_fifo.allow_compaction: 0
2020/05/22-13:22:50.555023 7f33fc5e8f00                   Options.table_properties_collectors: 
2020/05/22-13:22:50.555024 7f33fc5e8f00                   Options.inplace_update_support: 0
2020/05/22-13:22:50.555025 7f33fc5e8f00                 Options.inplace_update_num_locks: 10000
2020/05/22-13:22:50.555026 7f33fc5e8f00               Options.memtable_prefix_bloom_size_ratio: 0.000000
2020/05/22-13:22:50.555027 7f33fc5e8f00               Options.memtable_whole_key_filtering: 0
2020/05/22-13:22:50.555028 7f33fc5e8f00   Options.memtable_huge_page_size: 0
2020/05/22-13:22:50.555029 7f33fc5e8f00                           Options.bloom_locality: 0
2020/05/22-13:22:50.555029 7f33fc5e8f00                    Options.max_successive_merges: 0
2020/05/22-13:22:50.555030 7f33fc5e8f00                Options.optimize_filters_for_hits: 0
2020/05/22-13:22:50.555031 7f33fc5e8f00                Options.paranoid_file_checks: 0
2020/05/22-13:22:50.555032 7f33fc5e8f00                Options.force_consistency_checks: 0
2020/05/22-13:22:50.555033 7f33fc5e8f00                Options.report_bg_io_stats: 0
2020/05/22-13:22:50.555033 7f33fc5e8f00                               Options.ttl: 2592000
2020/05/22-13:22:50.555034 7f33fc5e8f00          Options.periodic_compaction_seconds: 2592000
2020/05/22-13:22:50.555064 7f33fc5e8f00 [lumn_family.cc:550] --------------- Options for column family [config]:
2020/05/22-13:22:50.555065 7f33fc5e8f00               Options.comparator: leveldb.BytewiseComparator
2020/05/22-13:22:50.555066 7f33fc5e8f00           Options.merge_operator: None
2020/05/22-13:22:50.555067 7f33fc5e8f00        Options.compaction_filter: None
2020/05/22-13:22:50.555068 7f33fc5e8f00        Options.compaction_filter_factory: None
2020/05/22-13:22:50.555069 7f33fc5e8f00         Options.memtable_factory: VectorRepFactory
2020/05/22-13:22:50.555069 7f33fc5e8f00            Options.table_factory: BlockBasedTable
2020/05/22-13:22:50.555082 7f33fc5e8f00            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5638c8d81d40)
  cache_index_and_filter_blocks: 1
  cache_index_and_filter_blocks_with_high_priority: 1
  pin_l0_filter_and_index_blocks_in_cache: 0
  pin_top_level_index_and_filter: 1
  index_type: 0
  data_block_index_type: 0
  index_shortening: 1
  data_block_hash_table_util_ratio: 0.750000
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x5638c8dea9d0
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 13473801830
    num_shard_bits : 6
    strict_capacity_limit : 0
    memory_allocator : None
    high_pri_pool_ratio: 0.500
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 1048576
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 4
  enable_index_compression: 1
  block_align: 0
2020/05/22-13:22:50.555083 7f33fc5e8f00        Options.write_buffer_size: 8982534553
2020/05/22-13:22:50.555084 7f33fc5e8f00  Options.max_write_buffer_number: 4
2020/05/22-13:22:50.555085 7f33fc5e8f00          Options.compression: ZSTD
2020/05/22-13:22:50.555085 7f33fc5e8f00                  Options.bottommost_compression: Disabled
2020/05/22-13:22:50.555086 7f33fc5e8f00       Options.prefix_extractor: nullptr
2020/05/22-13:22:50.555087 7f33fc5e8f00   Options.memtable_insert_with_hint_prefix_extractor: nullptr
2020/05/22-13:22:50.555088 7f33fc5e8f00             Options.num_levels: 4
2020/05/22-13:22:50.555088 7f33fc5e8f00        Options.min_write_buffer_number_to_merge: 1
2020/05/22-13:22:50.555089 7f33fc5e8f00     Options.max_write_buffer_number_to_maintain: 0
2020/05/22-13:22:50.555090 7f33fc5e8f00     Options.max_write_buffer_size_to_maintain: 0
2020/05/22-13:22:50.555091 7f33fc5e8f00            Options.bottommost_compression_opts.window_bits: -14
2020/05/22-13:22:50.555092 7f33fc5e8f00                  Options.bottommost_compression_opts.level: 32767
2020/05/22-13:22:50.555092 7f33fc5e8f00               Options.bottommost_compression_opts.strategy: 0
2020/05/22-13:22:50.555093 7f33fc5e8f00         Options.bottommost_compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555094 7f33fc5e8f00         Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555095 7f33fc5e8f00                  Options.bottommost_compression_opts.enabled: false
2020/05/22-13:22:50.555096 7f33fc5e8f00            Options.compression_opts.window_bits: -14
2020/05/22-13:22:50.555096 7f33fc5e8f00                  Options.compression_opts.level: 2
2020/05/22-13:22:50.555097 7f33fc5e8f00               Options.compression_opts.strategy: 0
2020/05/22-13:22:50.555098 7f33fc5e8f00         Options.compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555099 7f33fc5e8f00         Options.compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555100 7f33fc5e8f00                  Options.compression_opts.enabled: false
2020/05/22-13:22:50.555100 7f33fc5e8f00      Options.level0_file_num_compaction_trigger: 4
2020/05/22-13:22:50.555101 7f33fc5e8f00          Options.level0_slowdown_writes_trigger: 1073741824
2020/05/22-13:22:50.555102 7f33fc5e8f00              Options.level0_stop_writes_trigger: 1073741824
2020/05/22-13:22:50.555109 7f33fc5e8f00                   Options.target_file_size_base: 4294967296
2020/05/22-13:22:50.555110 7f33fc5e8f00             Options.target_file_size_multiplier: 1
2020/05/22-13:22:50.555110 7f33fc5e8f00                Options.max_bytes_for_level_base: 268435456
2020/05/22-13:22:50.555111 7f33fc5e8f00 Options.level_compaction_dynamic_level_bytes: 0
2020/05/22-13:22:50.555112 7f33fc5e8f00          Options.max_bytes_for_level_multiplier: 10.000000
2020/05/22-13:22:50.555113 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2020/05/22-13:22:50.555114 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2020/05/22-13:22:50.555115 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2020/05/22-13:22:50.555116 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2020/05/22-13:22:50.555117 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2020/05/22-13:22:50.555117 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2020/05/22-13:22:50.555118 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2020/05/22-13:22:50.555119 7f33fc5e8f00       Options.max_sequential_skip_in_iterations: 8
2020/05/22-13:22:50.555120 7f33fc5e8f00                    Options.max_compaction_bytes: 107374182400
2020/05/22-13:22:50.555121 7f33fc5e8f00                        Options.arena_block_size: 1122820096
2020/05/22-13:22:50.555121 7f33fc5e8f00   Options.soft_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555122 7f33fc5e8f00   Options.hard_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555123 7f33fc5e8f00       Options.rate_limit_delay_max_milliseconds: 100
2020/05/22-13:22:50.555124 7f33fc5e8f00                Options.disable_auto_compactions: 0
2020/05/22-13:22:50.555125 7f33fc5e8f00                        Options.compaction_style: kCompactionStyleUniversal
2020/05/22-13:22:50.555126 7f33fc5e8f00                          Options.compaction_pri: kMinOverlappingRatio
2020/05/22-13:22:50.555127 7f33fc5e8f00 Options.compaction_options_universal.size_ratio: 10
2020/05/22-13:22:50.555127 7f33fc5e8f00 Options.compaction_options_universal.min_merge_width: 2
2020/05/22-13:22:50.555128 7f33fc5e8f00 Options.compaction_options_universal.max_merge_width: 6
2020/05/22-13:22:50.555129 7f33fc5e8f00 Options.compaction_options_universal.max_size_amplification_percent: 1073741824
2020/05/22-13:22:50.555130 7f33fc5e8f00 Options.compaction_options_universal.compression_size_percent: -1
2020/05/22-13:22:50.555131 7f33fc5e8f00 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2020/05/22-13:22:50.555132 7f33fc5e8f00 Options.compaction_options_fifo.max_table_files_size: 1073741824
2020/05/22-13:22:50.555132 7f33fc5e8f00 Options.compaction_options_fifo.allow_compaction: 0
2020/05/22-13:22:50.555133 7f33fc5e8f00                   Options.table_properties_collectors: 
2020/05/22-13:22:50.555134 7f33fc5e8f00                   Options.inplace_update_support: 0
2020/05/22-13:22:50.555135 7f33fc5e8f00                 Options.inplace_update_num_locks: 10000
2020/05/22-13:22:50.555136 7f33fc5e8f00               Options.memtable_prefix_bloom_size_ratio: 0.000000
2020/05/22-13:22:50.555137 7f33fc5e8f00               Options.memtable_whole_key_filtering: 0
2020/05/22-13:22:50.555137 7f33fc5e8f00   Options.memtable_huge_page_size: 0
2020/05/22-13:22:50.555138 7f33fc5e8f00                           Options.bloom_locality: 0
2020/05/22-13:22:50.555139 7f33fc5e8f00                    Options.max_successive_merges: 0
2020/05/22-13:22:50.555140 7f33fc5e8f00                Options.optimize_filters_for_hits: 0
2020/05/22-13:22:50.555141 7f33fc5e8f00                Options.paranoid_file_checks: 0
2020/05/22-13:22:50.555141 7f33fc5e8f00                Options.force_consistency_checks: 0
2020/05/22-13:22:50.555142 7f33fc5e8f00                Options.report_bg_io_stats: 0
2020/05/22-13:22:50.555143 7f33fc5e8f00                               Options.ttl: 2592000
2020/05/22-13:22:50.555144 7f33fc5e8f00          Options.periodic_compaction_seconds: 2592000
2020/05/22-13:22:50.555161 7f33fc5e8f00 [lumn_family.cc:550] --------------- Options for column family [sampleset]:
2020/05/22-13:22:50.555163 7f33fc5e8f00               Options.comparator: leveldb.BytewiseComparator
2020/05/22-13:22:50.555164 7f33fc5e8f00           Options.merge_operator: None
2020/05/22-13:22:50.555164 7f33fc5e8f00        Options.compaction_filter: None
2020/05/22-13:22:50.555165 7f33fc5e8f00        Options.compaction_filter_factory: None
2020/05/22-13:22:50.555166 7f33fc5e8f00         Options.memtable_factory: VectorRepFactory
2020/05/22-13:22:50.555167 7f33fc5e8f00            Options.table_factory: BlockBasedTable
2020/05/22-13:22:50.555177 7f33fc5e8f00            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5638c8d7f3e0)
  cache_index_and_filter_blocks: 1
  cache_index_and_filter_blocks_with_high_priority: 1
  pin_l0_filter_and_index_blocks_in_cache: 0
  pin_top_level_index_and_filter: 1
  index_type: 0
  data_block_index_type: 0
  index_shortening: 1
  data_block_hash_table_util_ratio: 0.750000
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x5638c8dea9d0
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 13473801830
    num_shard_bits : 6
    strict_capacity_limit : 0
    memory_allocator : None
    high_pri_pool_ratio: 0.500
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 1048576
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 4
  enable_index_compression: 1
  block_align: 0
2020/05/22-13:22:50.555178 7f33fc5e8f00        Options.write_buffer_size: 8982534553
2020/05/22-13:22:50.555179 7f33fc5e8f00  Options.max_write_buffer_number: 4
2020/05/22-13:22:50.555180 7f33fc5e8f00          Options.compression: ZSTD
2020/05/22-13:22:50.555181 7f33fc5e8f00                  Options.bottommost_compression: Disabled
2020/05/22-13:22:50.555182 7f33fc5e8f00       Options.prefix_extractor: nullptr
2020/05/22-13:22:50.555183 7f33fc5e8f00   Options.memtable_insert_with_hint_prefix_extractor: nullptr
2020/05/22-13:22:50.555183 7f33fc5e8f00             Options.num_levels: 4
2020/05/22-13:22:50.555184 7f33fc5e8f00        Options.min_write_buffer_number_to_merge: 1
2020/05/22-13:22:50.555185 7f33fc5e8f00     Options.max_write_buffer_number_to_maintain: 0
2020/05/22-13:22:50.555186 7f33fc5e8f00     Options.max_write_buffer_size_to_maintain: 0
2020/05/22-13:22:50.555186 7f33fc5e8f00            Options.bottommost_compression_opts.window_bits: -14
2020/05/22-13:22:50.555187 7f33fc5e8f00                  Options.bottommost_compression_opts.level: 32767
2020/05/22-13:22:50.555188 7f33fc5e8f00               Options.bottommost_compression_opts.strategy: 0
2020/05/22-13:22:50.555189 7f33fc5e8f00         Options.bottommost_compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555190 7f33fc5e8f00         Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555190 7f33fc5e8f00                  Options.bottommost_compression_opts.enabled: false
2020/05/22-13:22:50.555191 7f33fc5e8f00            Options.compression_opts.window_bits: -14
2020/05/22-13:22:50.555192 7f33fc5e8f00                  Options.compression_opts.level: 2
2020/05/22-13:22:50.555193 7f33fc5e8f00               Options.compression_opts.strategy: 0
2020/05/22-13:22:50.555193 7f33fc5e8f00         Options.compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555194 7f33fc5e8f00         Options.compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555195 7f33fc5e8f00                  Options.compression_opts.enabled: false
2020/05/22-13:22:50.555196 7f33fc5e8f00      Options.level0_file_num_compaction_trigger: 4
2020/05/22-13:22:50.555197 7f33fc5e8f00          Options.level0_slowdown_writes_trigger: 1073741824
2020/05/22-13:22:50.555204 7f33fc5e8f00              Options.level0_stop_writes_trigger: 1073741824
2020/05/22-13:22:50.555205 7f33fc5e8f00                   Options.target_file_size_base: 4294967296
2020/05/22-13:22:50.555205 7f33fc5e8f00             Options.target_file_size_multiplier: 1
2020/05/22-13:22:50.555206 7f33fc5e8f00                Options.max_bytes_for_level_base: 268435456
2020/05/22-13:22:50.555207 7f33fc5e8f00 Options.level_compaction_dynamic_level_bytes: 0
2020/05/22-13:22:50.555208 7f33fc5e8f00          Options.max_bytes_for_level_multiplier: 10.000000
2020/05/22-13:22:50.555209 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2020/05/22-13:22:50.555210 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2020/05/22-13:22:50.555211 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2020/05/22-13:22:50.555212 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2020/05/22-13:22:50.555212 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2020/05/22-13:22:50.555213 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2020/05/22-13:22:50.555214 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2020/05/22-13:22:50.555215 7f33fc5e8f00       Options.max_sequential_skip_in_iterations: 8
2020/05/22-13:22:50.555216 7f33fc5e8f00                    Options.max_compaction_bytes: 107374182400
2020/05/22-13:22:50.555216 7f33fc5e8f00                        Options.arena_block_size: 1122820096
2020/05/22-13:22:50.555217 7f33fc5e8f00   Options.soft_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555218 7f33fc5e8f00   Options.hard_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555219 7f33fc5e8f00       Options.rate_limit_delay_max_milliseconds: 100
2020/05/22-13:22:50.555219 7f33fc5e8f00                Options.disable_auto_compactions: 0
2020/05/22-13:22:50.555221 7f33fc5e8f00                        Options.compaction_style: kCompactionStyleUniversal
2020/05/22-13:22:50.555221 7f33fc5e8f00                          Options.compaction_pri: kMinOverlappingRatio
2020/05/22-13:22:50.555222 7f33fc5e8f00 Options.compaction_options_universal.size_ratio: 10
2020/05/22-13:22:50.555223 7f33fc5e8f00 Options.compaction_options_universal.min_merge_width: 2
2020/05/22-13:22:50.555224 7f33fc5e8f00 Options.compaction_options_universal.max_merge_width: 6
2020/05/22-13:22:50.555225 7f33fc5e8f00 Options.compaction_options_universal.max_size_amplification_percent: 1073741824
2020/05/22-13:22:50.555225 7f33fc5e8f00 Options.compaction_options_universal.compression_size_percent: -1
2020/05/22-13:22:50.555226 7f33fc5e8f00 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2020/05/22-13:22:50.555227 7f33fc5e8f00 Options.compaction_options_fifo.max_table_files_size: 1073741824
2020/05/22-13:22:50.555228 7f33fc5e8f00 Options.compaction_options_fifo.allow_compaction: 0
2020/05/22-13:22:50.555229 7f33fc5e8f00                   Options.table_properties_collectors: 
2020/05/22-13:22:50.555229 7f33fc5e8f00                   Options.inplace_update_support: 0
2020/05/22-13:22:50.555230 7f33fc5e8f00                 Options.inplace_update_num_locks: 10000
2020/05/22-13:22:50.555231 7f33fc5e8f00               Options.memtable_prefix_bloom_size_ratio: 0.000000
2020/05/22-13:22:50.555232 7f33fc5e8f00               Options.memtable_whole_key_filtering: 0
2020/05/22-13:22:50.555233 7f33fc5e8f00   Options.memtable_huge_page_size: 0
2020/05/22-13:22:50.555234 7f33fc5e8f00                           Options.bloom_locality: 0
2020/05/22-13:22:50.555234 7f33fc5e8f00                    Options.max_successive_merges: 0
2020/05/22-13:22:50.555235 7f33fc5e8f00                Options.optimize_filters_for_hits: 0
2020/05/22-13:22:50.555236 7f33fc5e8f00                Options.paranoid_file_checks: 0
2020/05/22-13:22:50.555237 7f33fc5e8f00                Options.force_consistency_checks: 0
2020/05/22-13:22:50.555237 7f33fc5e8f00                Options.report_bg_io_stats: 0
2020/05/22-13:22:50.555238 7f33fc5e8f00                               Options.ttl: 2592000
2020/05/22-13:22:50.555244 7f33fc5e8f00          Options.periodic_compaction_seconds: 2592000
2020/05/22-13:22:50.555257 7f33fc5e8f00 [lumn_family.cc:550] --------------- Options for column family [sample_dataset]:
2020/05/22-13:22:50.555258 7f33fc5e8f00               Options.comparator: leveldb.BytewiseComparator
2020/05/22-13:22:50.555259 7f33fc5e8f00           Options.merge_operator: None
2020/05/22-13:22:50.555260 7f33fc5e8f00        Options.compaction_filter: None
2020/05/22-13:22:50.555261 7f33fc5e8f00        Options.compaction_filter_factory: None
2020/05/22-13:22:50.555261 7f33fc5e8f00         Options.memtable_factory: VectorRepFactory
2020/05/22-13:22:50.555262 7f33fc5e8f00            Options.table_factory: BlockBasedTable
2020/05/22-13:22:50.555272 7f33fc5e8f00            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5638c8dd6e30)
  cache_index_and_filter_blocks: 1
  cache_index_and_filter_blocks_with_high_priority: 1
  pin_l0_filter_and_index_blocks_in_cache: 0
  pin_top_level_index_and_filter: 1
  index_type: 0
  data_block_index_type: 0
  index_shortening: 1
  data_block_hash_table_util_ratio: 0.750000
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x5638c8dea9d0
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 13473801830
    num_shard_bits : 6
    strict_capacity_limit : 0
    memory_allocator : None
    high_pri_pool_ratio: 0.500
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 1048576
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 4
  enable_index_compression: 1
  block_align: 0
2020/05/22-13:22:50.555273 7f33fc5e8f00        Options.write_buffer_size: 8982534553
2020/05/22-13:22:50.555274 7f33fc5e8f00  Options.max_write_buffer_number: 4
2020/05/22-13:22:50.555275 7f33fc5e8f00          Options.compression: ZSTD
2020/05/22-13:22:50.555276 7f33fc5e8f00                  Options.bottommost_compression: Disabled
2020/05/22-13:22:50.555276 7f33fc5e8f00       Options.prefix_extractor: nullptr
2020/05/22-13:22:50.555277 7f33fc5e8f00   Options.memtable_insert_with_hint_prefix_extractor: nullptr
2020/05/22-13:22:50.555278 7f33fc5e8f00             Options.num_levels: 4
2020/05/22-13:22:50.555279 7f33fc5e8f00        Options.min_write_buffer_number_to_merge: 1
2020/05/22-13:22:50.555279 7f33fc5e8f00     Options.max_write_buffer_number_to_maintain: 0
2020/05/22-13:22:50.555280 7f33fc5e8f00     Options.max_write_buffer_size_to_maintain: 0
2020/05/22-13:22:50.555281 7f33fc5e8f00            Options.bottommost_compression_opts.window_bits: -14
2020/05/22-13:22:50.555282 7f33fc5e8f00                  Options.bottommost_compression_opts.level: 32767
2020/05/22-13:22:50.555283 7f33fc5e8f00               Options.bottommost_compression_opts.strategy: 0
2020/05/22-13:22:50.555283 7f33fc5e8f00         Options.bottommost_compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555284 7f33fc5e8f00         Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555285 7f33fc5e8f00                  Options.bottommost_compression_opts.enabled: false
2020/05/22-13:22:50.555286 7f33fc5e8f00            Options.compression_opts.window_bits: -14
2020/05/22-13:22:50.555287 7f33fc5e8f00                  Options.compression_opts.level: 2
2020/05/22-13:22:50.555287 7f33fc5e8f00               Options.compression_opts.strategy: 0
2020/05/22-13:22:50.555288 7f33fc5e8f00         Options.compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555289 7f33fc5e8f00         Options.compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555290 7f33fc5e8f00                  Options.compression_opts.enabled: false
2020/05/22-13:22:50.555290 7f33fc5e8f00      Options.level0_file_num_compaction_trigger: 4
2020/05/22-13:22:50.555291 7f33fc5e8f00          Options.level0_slowdown_writes_trigger: 1073741824
2020/05/22-13:22:50.555298 7f33fc5e8f00              Options.level0_stop_writes_trigger: 1073741824
2020/05/22-13:22:50.555299 7f33fc5e8f00                   Options.target_file_size_base: 4294967296
2020/05/22-13:22:50.555299 7f33fc5e8f00             Options.target_file_size_multiplier: 1
2020/05/22-13:22:50.555300 7f33fc5e8f00                Options.max_bytes_for_level_base: 268435456
2020/05/22-13:22:50.555301 7f33fc5e8f00 Options.level_compaction_dynamic_level_bytes: 0
2020/05/22-13:22:50.555302 7f33fc5e8f00          Options.max_bytes_for_level_multiplier: 10.000000
2020/05/22-13:22:50.555303 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2020/05/22-13:22:50.555304 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2020/05/22-13:22:50.555305 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2020/05/22-13:22:50.555306 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2020/05/22-13:22:50.555306 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2020/05/22-13:22:50.555307 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2020/05/22-13:22:50.555308 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2020/05/22-13:22:50.555309 7f33fc5e8f00       Options.max_sequential_skip_in_iterations: 8
2020/05/22-13:22:50.555309 7f33fc5e8f00                    Options.max_compaction_bytes: 107374182400
2020/05/22-13:22:50.555310 7f33fc5e8f00                        Options.arena_block_size: 1122820096
2020/05/22-13:22:50.555311 7f33fc5e8f00   Options.soft_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555312 7f33fc5e8f00   Options.hard_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555313 7f33fc5e8f00       Options.rate_limit_delay_max_milliseconds: 100
2020/05/22-13:22:50.555313 7f33fc5e8f00                Options.disable_auto_compactions: 0
2020/05/22-13:22:50.555314 7f33fc5e8f00                        Options.compaction_style: kCompactionStyleUniversal
2020/05/22-13:22:50.555315 7f33fc5e8f00                          Options.compaction_pri: kMinOverlappingRatio
2020/05/22-13:22:50.555316 7f33fc5e8f00 Options.compaction_options_universal.size_ratio: 10
2020/05/22-13:22:50.555317 7f33fc5e8f00 Options.compaction_options_universal.min_merge_width: 2
2020/05/22-13:22:50.555317 7f33fc5e8f00 Options.compaction_options_universal.max_merge_width: 6
2020/05/22-13:22:50.555318 7f33fc5e8f00 Options.compaction_options_universal.max_size_amplification_percent: 1073741824
2020/05/22-13:22:50.555319 7f33fc5e8f00 Options.compaction_options_universal.compression_size_percent: -1
2020/05/22-13:22:50.555320 7f33fc5e8f00 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2020/05/22-13:22:50.555321 7f33fc5e8f00 Options.compaction_options_fifo.max_table_files_size: 1073741824
2020/05/22-13:22:50.555322 7f33fc5e8f00 Options.compaction_options_fifo.allow_compaction: 0
2020/05/22-13:22:50.555322 7f33fc5e8f00                   Options.table_properties_collectors: 
2020/05/22-13:22:50.555323 7f33fc5e8f00                   Options.inplace_update_support: 0
2020/05/22-13:22:50.555324 7f33fc5e8f00                 Options.inplace_update_num_locks: 10000
2020/05/22-13:22:50.555325 7f33fc5e8f00               Options.memtable_prefix_bloom_size_ratio: 0.000000
2020/05/22-13:22:50.555326 7f33fc5e8f00               Options.memtable_whole_key_filtering: 0
2020/05/22-13:22:50.555326 7f33fc5e8f00   Options.memtable_huge_page_size: 0
2020/05/22-13:22:50.555327 7f33fc5e8f00                           Options.bloom_locality: 0
2020/05/22-13:22:50.555328 7f33fc5e8f00                    Options.max_successive_merges: 0
2020/05/22-13:22:50.555329 7f33fc5e8f00                Options.optimize_filters_for_hits: 0
2020/05/22-13:22:50.555329 7f33fc5e8f00                Options.paranoid_file_checks: 0
2020/05/22-13:22:50.555330 7f33fc5e8f00                Options.force_consistency_checks: 0
2020/05/22-13:22:50.555331 7f33fc5e8f00                Options.report_bg_io_stats: 0
2020/05/22-13:22:50.555332 7f33fc5e8f00                               Options.ttl: 2592000
2020/05/22-13:22:50.555337 7f33fc5e8f00          Options.periodic_compaction_seconds: 2592000
2020/05/22-13:22:50.555349 7f33fc5e8f00 [lumn_family.cc:550] --------------- Options for column family [header]:
2020/05/22-13:22:50.555351 7f33fc5e8f00               Options.comparator: leveldb.BytewiseComparator
2020/05/22-13:22:50.555351 7f33fc5e8f00           Options.merge_operator: None
2020/05/22-13:22:50.555352 7f33fc5e8f00        Options.compaction_filter: None
2020/05/22-13:22:50.555353 7f33fc5e8f00        Options.compaction_filter_factory: None
2020/05/22-13:22:50.555354 7f33fc5e8f00         Options.memtable_factory: VectorRepFactory
2020/05/22-13:22:50.555355 7f33fc5e8f00            Options.table_factory: BlockBasedTable
2020/05/22-13:22:50.555365 7f33fc5e8f00            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5638c8dda6d0)
  cache_index_and_filter_blocks: 1
  cache_index_and_filter_blocks_with_high_priority: 1
  pin_l0_filter_and_index_blocks_in_cache: 0
  pin_top_level_index_and_filter: 1
  index_type: 0
  data_block_index_type: 0
  index_shortening: 1
  data_block_hash_table_util_ratio: 0.750000
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x5638c8dea9d0
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 13473801830
    num_shard_bits : 6
    strict_capacity_limit : 0
    memory_allocator : None
    high_pri_pool_ratio: 0.500
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 1048576
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 4
  enable_index_compression: 1
  block_align: 0
2020/05/22-13:22:50.555366 7f33fc5e8f00        Options.write_buffer_size: 8982534553
2020/05/22-13:22:50.555366 7f33fc5e8f00  Options.max_write_buffer_number: 4
2020/05/22-13:22:50.555367 7f33fc5e8f00          Options.compression: ZSTD
2020/05/22-13:22:50.555368 7f33fc5e8f00                  Options.bottommost_compression: Disabled
2020/05/22-13:22:50.555369 7f33fc5e8f00       Options.prefix_extractor: nullptr
2020/05/22-13:22:50.555370 7f33fc5e8f00   Options.memtable_insert_with_hint_prefix_extractor: nullptr
2020/05/22-13:22:50.555370 7f33fc5e8f00             Options.num_levels: 4
2020/05/22-13:22:50.555371 7f33fc5e8f00        Options.min_write_buffer_number_to_merge: 1
2020/05/22-13:22:50.555372 7f33fc5e8f00     Options.max_write_buffer_number_to_maintain: 0
2020/05/22-13:22:50.555373 7f33fc5e8f00     Options.max_write_buffer_size_to_maintain: 0
2020/05/22-13:22:50.555373 7f33fc5e8f00            Options.bottommost_compression_opts.window_bits: -14
2020/05/22-13:22:50.555374 7f33fc5e8f00                  Options.bottommost_compression_opts.level: 32767
2020/05/22-13:22:50.555375 7f33fc5e8f00               Options.bottommost_compression_opts.strategy: 0
2020/05/22-13:22:50.555376 7f33fc5e8f00         Options.bottommost_compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555377 7f33fc5e8f00         Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555377 7f33fc5e8f00                  Options.bottommost_compression_opts.enabled: false
2020/05/22-13:22:50.555378 7f33fc5e8f00            Options.compression_opts.window_bits: -14
2020/05/22-13:22:50.555379 7f33fc5e8f00                  Options.compression_opts.level: 2
2020/05/22-13:22:50.555380 7f33fc5e8f00               Options.compression_opts.strategy: 0
2020/05/22-13:22:50.555380 7f33fc5e8f00         Options.compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555381 7f33fc5e8f00         Options.compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555382 7f33fc5e8f00                  Options.compression_opts.enabled: false
2020/05/22-13:22:50.555383 7f33fc5e8f00      Options.level0_file_num_compaction_trigger: 4
2020/05/22-13:22:50.555384 7f33fc5e8f00          Options.level0_slowdown_writes_trigger: 1073741824
2020/05/22-13:22:50.555390 7f33fc5e8f00              Options.level0_stop_writes_trigger: 1073741824
2020/05/22-13:22:50.555391 7f33fc5e8f00                   Options.target_file_size_base: 4294967296
2020/05/22-13:22:50.555391 7f33fc5e8f00             Options.target_file_size_multiplier: 1
2020/05/22-13:22:50.555392 7f33fc5e8f00                Options.max_bytes_for_level_base: 268435456
2020/05/22-13:22:50.555393 7f33fc5e8f00 Options.level_compaction_dynamic_level_bytes: 0
2020/05/22-13:22:50.555394 7f33fc5e8f00          Options.max_bytes_for_level_multiplier: 10.000000
2020/05/22-13:22:50.555395 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2020/05/22-13:22:50.555396 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2020/05/22-13:22:50.555397 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2020/05/22-13:22:50.555398 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2020/05/22-13:22:50.555398 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2020/05/22-13:22:50.555399 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2020/05/22-13:22:50.555400 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2020/05/22-13:22:50.555401 7f33fc5e8f00       Options.max_sequential_skip_in_iterations: 8
2020/05/22-13:22:50.555401 7f33fc5e8f00                    Options.max_compaction_bytes: 107374182400
2020/05/22-13:22:50.555402 7f33fc5e8f00                        Options.arena_block_size: 1122820096
2020/05/22-13:22:50.555403 7f33fc5e8f00   Options.soft_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555404 7f33fc5e8f00   Options.hard_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555405 7f33fc5e8f00       Options.rate_limit_delay_max_milliseconds: 100
2020/05/22-13:22:50.555405 7f33fc5e8f00                Options.disable_auto_compactions: 0
2020/05/22-13:22:50.555406 7f33fc5e8f00                        Options.compaction_style: kCompactionStyleUniversal
2020/05/22-13:22:50.555407 7f33fc5e8f00                          Options.compaction_pri: kMinOverlappingRatio
2020/05/22-13:22:50.555408 7f33fc5e8f00 Options.compaction_options_universal.size_ratio: 10
2020/05/22-13:22:50.555409 7f33fc5e8f00 Options.compaction_options_universal.min_merge_width: 2
2020/05/22-13:22:50.555410 7f33fc5e8f00 Options.compaction_options_universal.max_merge_width: 6
2020/05/22-13:22:50.555411 7f33fc5e8f00 Options.compaction_options_universal.max_size_amplification_percent: 1073741824
2020/05/22-13:22:50.555411 7f33fc5e8f00 Options.compaction_options_universal.compression_size_percent: -1
2020/05/22-13:22:50.555412 7f33fc5e8f00 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2020/05/22-13:22:50.555413 7f33fc5e8f00 Options.compaction_options_fifo.max_table_files_size: 1073741824
2020/05/22-13:22:50.555414 7f33fc5e8f00 Options.compaction_options_fifo.allow_compaction: 0
2020/05/22-13:22:50.555415 7f33fc5e8f00                   Options.table_properties_collectors: 
2020/05/22-13:22:50.555415 7f33fc5e8f00                   Options.inplace_update_support: 0
2020/05/22-13:22:50.555416 7f33fc5e8f00                 Options.inplace_update_num_locks: 10000
2020/05/22-13:22:50.555417 7f33fc5e8f00               Options.memtable_prefix_bloom_size_ratio: 0.000000
2020/05/22-13:22:50.555418 7f33fc5e8f00               Options.memtable_whole_key_filtering: 0
2020/05/22-13:22:50.555419 7f33fc5e8f00   Options.memtable_huge_page_size: 0
2020/05/22-13:22:50.555419 7f33fc5e8f00                           Options.bloom_locality: 0
2020/05/22-13:22:50.555420 7f33fc5e8f00                    Options.max_successive_merges: 0
2020/05/22-13:22:50.555421 7f33fc5e8f00                Options.optimize_filters_for_hits: 0
2020/05/22-13:22:50.555422 7f33fc5e8f00                Options.paranoid_file_checks: 0
2020/05/22-13:22:50.555422 7f33fc5e8f00                Options.force_consistency_checks: 0
2020/05/22-13:22:50.555423 7f33fc5e8f00                Options.report_bg_io_stats: 0
2020/05/22-13:22:50.555424 7f33fc5e8f00                               Options.ttl: 2592000
2020/05/22-13:22:50.555429 7f33fc5e8f00          Options.periodic_compaction_seconds: 2592000
2020/05/22-13:22:50.555442 7f33fc5e8f00 [lumn_family.cc:550] --------------- Options for column family [bcf]:
2020/05/22-13:22:50.555443 7f33fc5e8f00               Options.comparator: leveldb.BytewiseComparator
2020/05/22-13:22:50.555443 7f33fc5e8f00           Options.merge_operator: None
2020/05/22-13:22:50.555444 7f33fc5e8f00        Options.compaction_filter: None
2020/05/22-13:22:50.555445 7f33fc5e8f00        Options.compaction_filter_factory: None
2020/05/22-13:22:50.555446 7f33fc5e8f00         Options.memtable_factory: VectorRepFactory
2020/05/22-13:22:50.555447 7f33fc5e8f00            Options.table_factory: BlockBasedTable
2020/05/22-13:22:50.555456 7f33fc5e8f00            table_factory options:   flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5638c8e02af0)
  cache_index_and_filter_blocks: 1
  cache_index_and_filter_blocks_with_high_priority: 1
  pin_l0_filter_and_index_blocks_in_cache: 0
  pin_top_level_index_and_filter: 1
  index_type: 1
  data_block_index_type: 0
  index_shortening: 1
  data_block_hash_table_util_ratio: 0.750000
  hash_index_allow_collision: 1
  checksum: 1
  no_block_cache: 0
  block_cache: 0x5638c8dea9d0
  block_cache_name: LRUCache
  block_cache_options:
    capacity : 13473801830
    num_shard_bits : 6
    strict_capacity_limit : 0
    memory_allocator : None
    high_pri_pool_ratio: 0.500
  block_cache_compressed: (nil)
  persistent_cache: (nil)
  block_size: 1048576
  block_size_deviation: 10
  block_restart_interval: 16
  index_block_restart_interval: 1
  metadata_block_size: 4096
  partition_filters: 0
  use_delta_encoding: 1
  filter_policy: nullptr
  whole_key_filtering: 1
  verify_compression: 0
  read_amp_bytes_per_bit: 0
  format_version: 4
  enable_index_compression: 1
  block_align: 0
2020/05/22-13:22:50.555457 7f33fc5e8f00        Options.write_buffer_size: 8982534553
2020/05/22-13:22:50.555458 7f33fc5e8f00  Options.max_write_buffer_number: 4
2020/05/22-13:22:50.555459 7f33fc5e8f00          Options.compression: ZSTD
2020/05/22-13:22:50.555460 7f33fc5e8f00                  Options.bottommost_compression: Disabled
2020/05/22-13:22:50.555461 7f33fc5e8f00       Options.prefix_extractor: rocksdb.FixedPrefix.8
2020/05/22-13:22:50.555462 7f33fc5e8f00   Options.memtable_insert_with_hint_prefix_extractor: nullptr
2020/05/22-13:22:50.555462 7f33fc5e8f00             Options.num_levels: 4
2020/05/22-13:22:50.555463 7f33fc5e8f00        Options.min_write_buffer_number_to_merge: 1
2020/05/22-13:22:50.555464 7f33fc5e8f00     Options.max_write_buffer_number_to_maintain: 0
2020/05/22-13:22:50.555465 7f33fc5e8f00     Options.max_write_buffer_size_to_maintain: 0
2020/05/22-13:22:50.555465 7f33fc5e8f00            Options.bottommost_compression_opts.window_bits: -14
2020/05/22-13:22:50.555466 7f33fc5e8f00                  Options.bottommost_compression_opts.level: 32767
2020/05/22-13:22:50.555467 7f33fc5e8f00               Options.bottommost_compression_opts.strategy: 0
2020/05/22-13:22:50.555468 7f33fc5e8f00         Options.bottommost_compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555469 7f33fc5e8f00         Options.bottommost_compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555469 7f33fc5e8f00                  Options.bottommost_compression_opts.enabled: false
2020/05/22-13:22:50.555470 7f33fc5e8f00            Options.compression_opts.window_bits: -14
2020/05/22-13:22:50.555471 7f33fc5e8f00                  Options.compression_opts.level: 2
2020/05/22-13:22:50.555472 7f33fc5e8f00               Options.compression_opts.strategy: 0
2020/05/22-13:22:50.555472 7f33fc5e8f00         Options.compression_opts.max_dict_bytes: 0
2020/05/22-13:22:50.555473 7f33fc5e8f00         Options.compression_opts.zstd_max_train_bytes: 0
2020/05/22-13:22:50.555474 7f33fc5e8f00                  Options.compression_opts.enabled: false
2020/05/22-13:22:50.555475 7f33fc5e8f00      Options.level0_file_num_compaction_trigger: 4
2020/05/22-13:22:50.555482 7f33fc5e8f00          Options.level0_slowdown_writes_trigger: 1073741824
2020/05/22-13:22:50.555483 7f33fc5e8f00              Options.level0_stop_writes_trigger: 1073741824
2020/05/22-13:22:50.555484 7f33fc5e8f00                   Options.target_file_size_base: 4294967296
2020/05/22-13:22:50.555485 7f33fc5e8f00             Options.target_file_size_multiplier: 1
2020/05/22-13:22:50.555486 7f33fc5e8f00                Options.max_bytes_for_level_base: 268435456
2020/05/22-13:22:50.555486 7f33fc5e8f00 Options.level_compaction_dynamic_level_bytes: 0
2020/05/22-13:22:50.555487 7f33fc5e8f00          Options.max_bytes_for_level_multiplier: 10.000000
2020/05/22-13:22:50.555488 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2020/05/22-13:22:50.555489 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2020/05/22-13:22:50.555490 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2020/05/22-13:22:50.555491 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2020/05/22-13:22:50.555492 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2020/05/22-13:22:50.555492 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2020/05/22-13:22:50.555493 7f33fc5e8f00 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2020/05/22-13:22:50.555494 7f33fc5e8f00       Options.max_sequential_skip_in_iterations: 8
2020/05/22-13:22:50.555495 7f33fc5e8f00                    Options.max_compaction_bytes: 107374182400
2020/05/22-13:22:50.555496 7f33fc5e8f00                        Options.arena_block_size: 1122820096
2020/05/22-13:22:50.555496 7f33fc5e8f00   Options.soft_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555497 7f33fc5e8f00   Options.hard_pending_compaction_bytes_limit: 0
2020/05/22-13:22:50.555498 7f33fc5e8f00       Options.rate_limit_delay_max_milliseconds: 100
2020/05/22-13:22:50.555499 7f33fc5e8f00                Options.disable_auto_compactions: 0
2020/05/22-13:22:50.555500 7f33fc5e8f00                        Options.compaction_style: kCompactionStyleUniversal
2020/05/22-13:22:50.555501 7f33fc5e8f00                          Options.compaction_pri: kMinOverlappingRatio
2020/05/22-13:22:50.555501 7f33fc5e8f00 Options.compaction_options_universal.size_ratio: 10
2020/05/22-13:22:50.555502 7f33fc5e8f00 Options.compaction_options_universal.min_merge_width: 2
2020/05/22-13:22:50.555503 7f33fc5e8f00 Options.compaction_options_universal.max_merge_width: 6
2020/05/22-13:22:50.555504 7f33fc5e8f00 Options.compaction_options_universal.max_size_amplification_percent: 1073741824
2020/05/22-13:22:50.555505 7f33fc5e8f00 Options.compaction_options_universal.compression_size_percent: -1
2020/05/22-13:22:50.555506 7f33fc5e8f00 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
2020/05/22-13:22:50.555506 7f33fc5e8f00 Options.compaction_options_fifo.max_table_files_size: 1073741824
2020/05/22-13:22:50.555507 7f33fc5e8f00 Options.compaction_options_fifo.allow_compaction: 0
2020/05/22-13:22:50.555508 7f33fc5e8f00                   Options.table_properties_collectors: 
2020/05/22-13:22:50.555509 7f33fc5e8f00                   Options.inplace_update_support: 0
2020/05/22-13:22:50.555509 7f33fc5e8f00                 Options.inplace_update_num_locks: 10000
2020/05/22-13:22:50.555510 7f33fc5e8f00               Options.memtable_prefix_bloom_size_ratio: 0.000000
2020/05/22-13:22:50.555511 7f33fc5e8f00               Options.memtable_whole_key_filtering: 0
2020/05/22-13:22:50.555512 7f33fc5e8f00   Options.memtable_huge_page_size: 0
2020/05/22-13:22:50.555513 7f33fc5e8f00                           Options.bloom_locality: 0
2020/05/22-13:22:50.555514 7f33fc5e8f00                    Options.max_successive_merges: 0
2020/05/22-13:22:50.555514 7f33fc5e8f00                Options.optimize_filters_for_hits: 0
2020/05/22-13:22:50.555515 7f33fc5e8f00                Options.paranoid_file_checks: 0
2020/05/22-13:22:50.555516 7f33fc5e8f00                Options.force_consistency_checks: 0
2020/05/22-13:22:50.555517 7f33fc5e8f00                Options.report_bg_io_stats: 0
2020/05/22-13:22:50.555522 7f33fc5e8f00                               Options.ttl: 2592000
2020/05/22-13:22:50.555523 7f33fc5e8f00          Options.periodic_compaction_seconds: 2592000
2020/05/22-13:22:50.558155 7f33fc5e8f00 [rsion_set.cc:4527] Recovered from manifest file:GLnexus.DB/MANIFEST-000006 succeeded,manifest_file_number is 6, next_file_number is 21, last_sequence is 4, log_number is 17,prev_log_number is 0,max_column_family is 5,min_log_number_to_keep is 0
2020/05/22-13:22:50.558160 7f33fc5e8f00 [rsion_set.cc:4536] Column family [default] (ID 0), log number is 0
2020/05/22-13:22:50.558161 7f33fc5e8f00 [rsion_set.cc:4536] Column family [config] (ID 1), log number is 17
2020/05/22-13:22:50.558163 7f33fc5e8f00 [rsion_set.cc:4536] Column family [sampleset] (ID 2), log number is 17
2020/05/22-13:22:50.558164 7f33fc5e8f00 [rsion_set.cc:4536] Column family [sample_dataset] (ID 3), log number is 3
2020/05/22-13:22:50.558165 7f33fc5e8f00 [rsion_set.cc:4536] Column family [header] (ID 4), log number is 3
2020/05/22-13:22:50.558166 7f33fc5e8f00 [rsion_set.cc:4536] Column family [bcf] (ID 5), log number is 3
2020/05/22-13:22:50.558300 7f33fc5e8f00 EVENT_LOG_v1 {"time_micros": 1590146570558298, "job": 1, "event": "recovery_started", "log_files": [17]}
2020/05/22-13:22:50.558303 7f33fc5e8f00 [_impl/db_impl_open.cc:735] Recovering log #17 mode 2
2020/05/22-13:22:50.558369 7f33fc5e8f00 [rsion_set.cc:3788] Creating manifest 21
2020/05/22-13:22:50.662608 7f33fc5e8f00 EVENT_LOG_v1 {"time_micros": 1590146570662599, "job": 1, "event": "recovery_finished"}
2020/05/22-13:22:50.715975 7f33fc5e8f00 DB pointer 0x5638c8dcde70
2020/05/22-13:22:50.717220 7f33a27fc700 [_impl/db_impl.cc:858] ------- DUMPING STATS -------
2020/05/22-13:22:50.717562 7f33a27fc700 [_impl/db_impl.cc:859] 
** DB Stats **
Uptime(secs): 0.2 total, 0.2 interval
Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent

** Compaction Stats [default] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [default] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.2 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [default] **

** Compaction Stats [config] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  L0      1/0    0.89 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Sum      1/0    0.89 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [config] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.2 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [config] **

** Compaction Stats [sampleset] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  L0      1/0    0.78 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Sum      1/0    0.78 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [sampleset] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.2 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [sampleset] **

** Compaction Stats [sample_dataset] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [sample_dataset] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.2 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [sample_dataset] **

** Compaction Stats [header] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [header] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.2 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [header] **

** Compaction Stats [bcf] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [bcf] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.2 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [bcf] **

** Compaction Stats [default] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [default] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [default] **

** Compaction Stats [config] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  L0      1/0    0.89 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Sum      1/0    0.89 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [config] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [config] **

** Compaction Stats [sampleset] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  L0      1/0    0.78 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Sum      1/0    0.78 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [sampleset] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [sampleset] **

** Compaction Stats [sample_dataset] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [sample_dataset] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [sample_dataset] **

** Compaction Stats [header] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [header] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [header] **

** Compaction Stats [bcf] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Sum      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [bcf] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Uptime(secs): 0.2 total, 0.0 interval
Flush(GB): cumulative 0.000, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [bcf] **
2020/05/22-13:22:59.881740 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1307] [bcf] Manual flush start.
2020/05/22-13:22:59.881806 7f33fc5e8f00 [_impl/db_impl_write.cc:1669] [bcf] New memtable created with log file: #22. Immutable memtables: 0.
2020/05/22-13:22:59.881929 7f33f17fa700 (Original Log Time 2020/05/22-13:22:59.881901) [_impl/db_impl_compaction_flush.cc:2197] Calling FlushMemTableToOutputFile with column family [bcf], flush slots available 2, compaction slots available 6, flush slots scheduled 2, compaction slots scheduled 0
2020/05/22-13:22:59.881931 7f33f17fa700 [ush_job.cc:320] [bcf] [JOB 3] Flushing memtable with next log file: 22
2020/05/22-13:22:59.881939 7f33f17fa700 EVENT_LOG_v1 {"time_micros": 1590146579881936, "job": 3, "event": "flush_started", "num_memtables": 1, "num_entries": 6728, "num_deletes": 0, "total_data_size": 887359956, "memory_usage": 887420020, "flush_reason": "Manual Flush"}
2020/05/22-13:22:59.881940 7f33f17fa700 [ush_job.cc:349] [bcf] [JOB 3] Level-0 flush table #25: started
2020/05/22-13:23:04.323421 7f33f17fa700 EVENT_LOG_v1 {"time_micros": 1590146584323361, "cf_name": "bcf", "job": 3, "event": "table_file_creation", "file_number": 25, "file_size": 162156078, "table_properties": {"data_size": 162136566, "index_size": 59481, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 158108, "raw_average_key_size": 23, "raw_value_size": 887175336, "raw_average_value_size": 131863, "num_data_blocks": 867, "num_entries": 6728, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "bcf", "column_family_id": 5, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "rocksdb.FixedPrefix.8", "property_collectors": "[]", "compression": "ZSTD", "compression_options": "window_bits=-14; level=2; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1590146579, "oldest_key_time": 1590146571, "file_creation_time": 1590146579}}
2020/05/22-13:23:04.323459 7f33f17fa700 [ush_job.cc:395] [bcf] [JOB 3] Level-0 flush table #25: 162156078 bytes OK
2020/05/22-13:23:04.413170 7f33f17fa700 (Original Log Time 2020/05/22-13:23:04.371338) [mtable_list.cc:447] [bcf] Level-0 commit table #25 started
2020/05/22-13:23:04.413182 7f33f17fa700 (Original Log Time 2020/05/22-13:23:04.413040) [mtable_list.cc:503] [bcf] Level-0 commit table #25: memtable #1 done
2020/05/22-13:23:04.413187 7f33f17fa700 (Original Log Time 2020/05/22-13:23:04.413078) EVENT_LOG_v1 {"time_micros": 1590146584413067, "job": 3, "event": "flush_finished", "output_compression": "ZSTD", "lsm_state": [1, 0, 0, 0], "immutable_memtables": 0}
2020/05/22-13:23:04.413192 7f33f17fa700 (Original Log Time 2020/05/22-13:23:04.413113) [_impl/db_impl_compaction_flush.cc:205] [bcf] Level summary: files[1 0 0 0] max score 0.25
2020/05/22-13:23:04.458368 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1318] [bcf] Manual flush finished, status: OK
2020/05/22-13:23:04.458390 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1307] [config] Manual flush start.
2020/05/22-13:23:04.458394 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1318] [config] Manual flush finished, status: OK
2020/05/22-13:23:04.458395 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1307] [default] Manual flush start.
2020/05/22-13:23:04.458397 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1318] [default] Manual flush finished, status: OK
2020/05/22-13:23:04.458398 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1307] [header] Manual flush start.
2020/05/22-13:23:04.458433 7f33fc5e8f00 [_impl/db_impl_write.cc:1669] [header] New memtable created with log file: #22. Immutable memtables: 0.
2020/05/22-13:23:04.458534 7f33bbfff700 (Original Log Time 2020/05/22-13:23:04.458513) [_impl/db_impl_compaction_flush.cc:2197] Calling FlushMemTableToOutputFile with column family [header], flush slots available 2, compaction slots available 6, flush slots scheduled 2, compaction slots scheduled 0
2020/05/22-13:23:04.458539 7f33bbfff700 [ush_job.cc:320] [header] [JOB 6] Flushing memtable with next log file: 22
2020/05/22-13:23:04.458565 7f33bbfff700 EVENT_LOG_v1 {"time_micros": 1590146584458561, "job": 6, "event": "flush_started", "num_memtables": 1, "num_entries": 2, "num_deletes": 0, "total_data_size": 2701, "memory_usage": 7604, "flush_reason": "Manual Flush"}
2020/05/22-13:23:04.458568 7f33bbfff700 [ush_job.cc:349] [header] [JOB 6] Level-0 flush table #26: started
2020/05/22-13:23:04.504969 7f33bbfff700 EVENT_LOG_v1 {"time_micros": 1590146584504938, "cf_name": "header", "job": 6, "event": "table_file_creation", "file_number": 26, "file_size": 1448, "table_properties": {"data_size": 678, "index_size": 26, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 31, "raw_average_key_size": 15, "raw_value_size": 2664, "raw_average_value_size": 1332, "num_data_blocks": 1, "num_entries": 2, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "header", "column_family_id": 4, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "ZSTD", "compression_options": "window_bits=-14; level=2; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1590146584, "oldest_key_time": 1590146579, "file_creation_time": 1590146584}}
2020/05/22-13:23:04.504999 7f33bbfff700 [ush_job.cc:395] [header] [JOB 6] Level-0 flush table #26: 1448 bytes OK
2020/05/22-13:23:04.563189 7f33bbfff700 (Original Log Time 2020/05/22-13:23:04.521382) [mtable_list.cc:447] [header] Level-0 commit table #26 started
2020/05/22-13:23:04.563198 7f33bbfff700 (Original Log Time 2020/05/22-13:23:04.563057) [mtable_list.cc:503] [header] Level-0 commit table #26: memtable #1 done
2020/05/22-13:23:04.563204 7f33bbfff700 (Original Log Time 2020/05/22-13:23:04.563091) EVENT_LOG_v1 {"time_micros": 1590146584563080, "job": 6, "event": "flush_finished", "output_compression": "ZSTD", "lsm_state": [1, 0, 0, 0], "immutable_memtables": 0}
2020/05/22-13:23:04.563209 7f33bbfff700 (Original Log Time 2020/05/22-13:23:04.563124) [_impl/db_impl_compaction_flush.cc:205] [header] Level summary: files[1 0 0 0] max score 0.25
2020/05/22-13:23:04.563352 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1318] [header] Manual flush finished, status: OK
2020/05/22-13:23:04.563368 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1307] [sample_dataset] Manual flush start.
2020/05/22-13:23:04.563390 7f33fc5e8f00 [_impl/db_impl_write.cc:1669] [sample_dataset] New memtable created with log file: #22. Immutable memtables: 0.
2020/05/22-13:23:04.563487 7f33f37fe700 (Original Log Time 2020/05/22-13:23:04.563463) [_impl/db_impl_compaction_flush.cc:2197] Calling FlushMemTableToOutputFile with column family [sample_dataset], flush slots available 2, compaction slots available 6, flush slots scheduled 2, compaction slots scheduled 0
2020/05/22-13:23:04.563495 7f33f37fe700 [ush_job.cc:320] [sample_dataset] [JOB 7] Flushing memtable with next log file: 22
2020/05/22-13:23:04.563529 7f33f37fe700 EVENT_LOG_v1 {"time_micros": 1590146584563513, "job": 7, "event": "flush_started", "num_memtables": 1, "num_entries": 2, "num_deletes": 0, "total_data_size": 45, "memory_usage": 493, "flush_reason": "Manual Flush"}
2020/05/22-13:23:04.563537 7f33f37fe700 [ush_job.cc:349] [sample_dataset] [JOB 7] Level-0 flush table #27: started
2020/05/22-13:23:04.597061 7f33f37fe700 EVENT_LOG_v1 {"time_micros": 1590146584597000, "cf_name": "sample_dataset", "job": 7, "event": "table_file_creation", "file_number": 27, "file_size": 833, "table_properties": {"data_size": 60, "index_size": 24, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 26, "raw_average_key_size": 13, "raw_value_size": 15, "raw_average_value_size": 7, "num_data_blocks": 1, "num_entries": 2, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "sample_dataset", "column_family_id": 3, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "ZSTD", "compression_options": "window_bits=-14; level=2; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1590146584, "oldest_key_time": 1590146579, "file_creation_time": 1590146584}}
2020/05/22-13:23:04.597119 7f33f37fe700 [ush_job.cc:395] [sample_dataset] [JOB 7] Level-0 flush table #27: 833 bytes OK
2020/05/22-13:23:04.663442 7f33f37fe700 (Original Log Time 2020/05/22-13:23:04.613287) [mtable_list.cc:447] [sample_dataset] Level-0 commit table #27 started
2020/05/22-13:23:04.663452 7f33f37fe700 (Original Log Time 2020/05/22-13:23:04.663307) [mtable_list.cc:503] [sample_dataset] Level-0 commit table #27: memtable #1 done
2020/05/22-13:23:04.663457 7f33f37fe700 (Original Log Time 2020/05/22-13:23:04.663343) EVENT_LOG_v1 {"time_micros": 1590146584663332, "job": 7, "event": "flush_finished", "output_compression": "ZSTD", "lsm_state": [1, 0, 0, 0], "immutable_memtables": 0}
2020/05/22-13:23:04.663462 7f33f37fe700 (Original Log Time 2020/05/22-13:23:04.663392) [_impl/db_impl_compaction_flush.cc:205] [sample_dataset] Level summary: files[1 0 0 0] max score 0.25
2020/05/22-13:23:04.663551 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1318] [sample_dataset] Manual flush finished, status: OK
2020/05/22-13:23:04.663567 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1307] [sampleset] Manual flush start.
2020/05/22-13:23:04.663588 7f33fc5e8f00 [_impl/db_impl_write.cc:1669] [sampleset] New memtable created with log file: #22. Immutable memtables: 0.
2020/05/22-13:23:04.663740 7f33f27fc700 (Original Log Time 2020/05/22-13:23:04.663683) [_impl/db_impl_compaction_flush.cc:2197] Calling FlushMemTableToOutputFile with column family [sampleset], flush slots available 2, compaction slots available 6, flush slots scheduled 2, compaction slots scheduled 0
2020/05/22-13:23:04.663751 7f33f27fc700 [ush_job.cc:320] [sampleset] [JOB 9] Flushing memtable with next log file: 22
2020/05/22-13:23:04.663780 7f33f27fc700 EVENT_LOG_v1 {"time_micros": 1590146584663769, "job": 9, "event": "flush_started", "num_memtables": 1, "num_entries": 7, "num_deletes": 0, "total_data_size": 109, "memory_usage": 597, "flush_reason": "Manual Flush"}
2020/05/22-13:23:04.663786 7f33f27fc700 [ush_job.cc:349] [sampleset] [JOB 9] Level-0 flush table #28: started
2020/05/22-13:23:04.705399 7f33f27fc700 EVENT_LOG_v1 {"time_micros": 1590146584705340, "cf_name": "sampleset", "job": 9, "event": "table_file_creation", "file_number": 28, "file_size": 858, "table_properties": {"data_size": 86, "index_size": 28, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 0, "raw_key_size": 84, "raw_average_key_size": 14, "raw_value_size": 1, "raw_average_value_size": 0, "num_data_blocks": 1, "num_entries": 6, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "", "column_family_name": "sampleset", "column_family_id": 2, "comparator": "leveldb.BytewiseComparator", "merge_operator": "nullptr", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "ZSTD", "compression_options": "window_bits=-14; level=2; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1590146584, "oldest_key_time": 1590146579, "file_creation_time": 1590146584}}
2020/05/22-13:23:04.705455 7f33f27fc700 [ush_job.cc:395] [sampleset] [JOB 9] Level-0 flush table #28: 858 bytes OK
2020/05/22-13:23:04.755335 7f33f27fc700 (Original Log Time 2020/05/22-13:23:04.721839) [mtable_list.cc:447] [sampleset] Level-0 commit table #28 started
2020/05/22-13:23:04.755345 7f33f27fc700 (Original Log Time 2020/05/22-13:23:04.755201) [mtable_list.cc:503] [sampleset] Level-0 commit table #28: memtable #1 done
2020/05/22-13:23:04.755350 7f33f27fc700 (Original Log Time 2020/05/22-13:23:04.755251) EVENT_LOG_v1 {"time_micros": 1590146584755226, "job": 9, "event": "flush_finished", "output_compression": "ZSTD", "lsm_state": [2, 0, 0, 0], "immutable_memtables": 0}
2020/05/22-13:23:04.755355 7f33f27fc700 (Original Log Time 2020/05/22-13:23:04.755286) [_impl/db_impl_compaction_flush.cc:205] [sampleset] Level summary: files[2 0 0 0] max score 0.50
2020/05/22-13:23:04.755443 7f33fc5e8f00 [_impl/db_impl_compaction_flush.cc:1318] [sampleset] Manual flush finished, status: OK
2020/05/22-13:23:04.755483 7f33fc5e8f00 [_impl/db_impl.cc:401] Shutdown: canceling all background work
2020/05/22-13:23:04.756386 7f33fc5e8f00 [_impl/db_impl.cc:582] Shutdown complete
ghost commented 4 years ago

Removing the said vcf solves the issue ... so there seems to be something with that vcf file but I can't get it. It works fine with other tools.

ghost commented 4 years ago

Okay found it, 2 of the vcf files had the same sample name.

Maybe the error message, in such case, should tell the user something like "duplicate sample name in vcf files"?

cheers and thanks for GLnexus, really cool software.

mlin commented 4 years ago

Yes, the error message "sample is currently being added" could be clarified. It reflects an internal distinction in the code path, that not only is there a duplicate sample name, but the duplicate is currently being processed at the exact same moment by a different worker thread! Some luck is needed to hit that :laughing: