vroyer
commented
6 years ago This is fixed in release candidate 5.5.0.16 available at https://github.com/strapdata/elassandra5-rc/releases. Thanks for your feedback.
Closed cevalogistics closed 6 years ago
vroyer
commented
6 years ago This is fixed in release candidate 5.5.0.16 available at https://github.com/strapdata/elassandra5-rc/releases. Thanks for your feedback.
cevalogistics
commented
6 years ago Vincent,
I’ll give that a try tomorrow for you.
I’ve a quick question. I have 6 nodes running elassandra in a test. Each has 16gb ram. I set these parameters in the container because the eden space default 200M keeps causing garbage collection.
HEAP_NEWSIZE: 1024M MAX_HEAP_SIZE: 8192M
Now 20 mins later eden space is full again. Any recommendation?
Best regards,
Bob Liotta SVP IT Enterprise Architect
CEVA Logistics / 10751 Deerwood Park, Blvd, Jacksonville, FL 32256 / www.cevalogistics.comhttp://www.cevalogistics.com O: +1 904.928.2322 / E: robert.liotta@cevalogistics.commailto:robert.liotta@cevalogistics.com
Making business flow
From: Vincent Royer notifications@github.com Reply-To: strapdata/elassandra reply@reply.github.com Date: Thursday, May 10, 2018 at 3:48 PM To: strapdata/elassandra elassandra@noreply.github.com Cc: "Liotta, Robert" Robert.Liotta@Cevalogistics.com, Author author@noreply.github.com Subject: Re: [strapdata/elassandra] Elassandra 5.5.0.15 (#191)
This is fixed in release candidate 5.5.0.16 available at https://github.com/strapdata/elassandra5-rc/releases. Thanks for your feedback.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/strapdata/elassandra/issues/191#issuecomment-388164840, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AQ-uq3DY5q2wlW4kzfiZpAWhZf0LC8fvks5txJmCgaJpZM4T4ljl.
NVOCC Services are provided by CEVA as agents for and on behalf of Pyramid Lines Limited trading as Pyramid Lines. This e-mail message is intended for the above named recipient(s) only. It may contain confidential information that is privileged. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail by error, please immediately notify the sender by replying to this e-mail and deleting the message including any attachment(s) from your system. Thank you in advance for your cooperation and assistance. Although the company has taken reasonable precautions to ensure no viruses are present in this email, the company cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
cevalogistics
commented
6 years ago Vincent,
PS. I only have 2 cpu per node. Just a small test server.
Best regards,
Bob Liotta SVP IT Enterprise Architect
CEVA Logistics / 10751 Deerwood Park, Blvd, Jacksonville, FL 32256 / www.cevalogistics.comhttp://www.cevalogistics.com O: +1 904.928.2322 / E: robert.liotta@cevalogistics.commailto:robert.liotta@cevalogistics.com
Making business flow
From: "Liotta, Robert" Robert.Liotta@Cevalogistics.com Date: Thursday, May 10, 2018 at 4:31 PM To: strapdata/elassandra reply@reply.github.com Subject: Re: [strapdata/elassandra] Elassandra 5.5.0.15 (#191)
Vincent,
I’ll give that a try tomorrow for you.
I’ve a quick question. I have 6 nodes running elassandra in a test. Each has 16gb ram. I set these parameters in the container because the eden space default 200M keeps causing garbage collection.
HEAP_NEWSIZE: 1024M MAX_HEAP_SIZE: 8192M
Now 20 mins later eden space is full again. Any recommendation?
Best regards,
Bob Liotta SVP IT Enterprise Architect
CEVA Logistics / 10751 Deerwood Park, Blvd, Jacksonville, FL 32256 / www.cevalogistics.comhttp://www.cevalogistics.com O: +1 904.928.2322 / E: robert.liotta@cevalogistics.commailto:robert.liotta@cevalogistics.com
Making business flow
From: Vincent Royer notifications@github.com Reply-To: strapdata/elassandra reply@reply.github.com Date: Thursday, May 10, 2018 at 3:48 PM To: strapdata/elassandra elassandra@noreply.github.com Cc: "Liotta, Robert" Robert.Liotta@Cevalogistics.com, Author author@noreply.github.com Subject: Re: [strapdata/elassandra] Elassandra 5.5.0.15 (#191)
This is fixed in release candidate 5.5.0.16 available at https://github.com/strapdata/elassandra5-rc/releases. Thanks for your feedback.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/strapdata/elassandra/issues/191#issuecomment-388164840, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AQ-uq3DY5q2wlW4kzfiZpAWhZf0LC8fvks5txJmCgaJpZM4T4ljl.
NVOCC Services are provided by CEVA as agents for and on behalf of Pyramid Lines Limited trading as Pyramid Lines. This e-mail message is intended for the above named recipient(s) only. It may contain confidential information that is privileged. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail by error, please immediately notify the sender by replying to this e-mail and deleting the message including any attachment(s) from your system. Thank you in advance for your cooperation and assistance. Although the company has taken reasonable precautions to ensure no viruses are present in this email, the company cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
vroyer
commented
6 years ago Hi, 2 cores, 8Gb RAM is enough to run elassandra. Internal activity of cassandra and elasticsearch consume the eden space fried by periodic GC. Here is a standard GC behvior of elassandra depending on its activity :
Here both cassandra and elasticsearch metrics are pushed to an influxdb DB and vizualized with grafana as describe in the enterprise documentation http://doc.elassandra.io/en/latest/enterprise.html#jmx-managment-monitoring
cevalogistics
commented
6 years ago Vincent,
The 5.5.0.16 looks to be working on Kubernetes.
Best regards,
Bob Liotta SVP IT Enterprise Architect
CEVA Logistics / 10751 Deerwood Park, Blvd, Jacksonville, FL 32256 / www.cevalogistics.comhttp://www.cevalogistics.com O: +1 904.928.2322 / E: robert.liotta@cevalogistics.commailto:robert.liotta@cevalogistics.com
Making business flow
From: Vincent Royer notifications@github.com Reply-To: strapdata/elassandra reply@reply.github.com Date: Thursday, May 10, 2018 at 3:48 PM To: strapdata/elassandra elassandra@noreply.github.com Cc: "Liotta, Robert" Robert.Liotta@Cevalogistics.com, Author author@noreply.github.com Subject: Re: [strapdata/elassandra] Elassandra 5.5.0.15 (#191)
This is fixed in release candidate 5.5.0.16 available at https://github.com/strapdata/elassandra5-rc/releases. Thanks for your feedback.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/strapdata/elassandra/issues/191#issuecomment-388164840, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AQ-uq3DY5q2wlW4kzfiZpAWhZf0LC8fvks5txJmCgaJpZM4T4ljl.
NVOCC Services are provided by CEVA as agents for and on behalf of Pyramid Lines Limited trading as Pyramid Lines. This e-mail message is intended for the above named recipient(s) only. It may contain confidential information that is privileged. If you are not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this e-mail and any attachment(s) is strictly prohibited. If you have received this e-mail by error, please immediately notify the sender by replying to this e-mail and deleting the message including any attachment(s) from your system. Thank you in advance for your cooperation and assistance. Although the company has taken reasonable precautions to ensure no viruses are present in this email, the company cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
Team,
I updated to 5.5.0.15. It does not start. I roll back to 5.5.0.13 works fine. Here is the log
Starting cassandra with org.apache.cassandra.service.ElassandraDaemon 2018-05-09 16:01:50,118 INFO [main] org.apache.cassandra.config.YamlConfigurationLoader.getStorageConfigURL(YamlConfigurationLoader.java:89) Configuration location: file:/opt/elassandra-5.5.0.15/conf/cassandra.yaml 2018-05-09 16:01:50,743 INFO [main] org.apache.cassandra.config.Config.log(Config.java:495) Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; back_pressure_enabled=false; back_pressure_strategy=null; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.233.117.217; broadcast_rpc_address=10.233.117.217; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=0; client_encryption_options=; cluster_name=Cassandra; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=null; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=NaN; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@19bb07ed; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_materialized_views=true; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=GossipingPropertyFileSnitch; file_cache_round_up=null; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=null; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=0; internode_send_buff_size_in_bytes=0; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.233.117.217; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=0; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=8; otc_backlog_expiration_interval_ms=200; otc_coalescing_enough_coalesced_messages=8; otc_coalescing_strategy=DISABLED; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=null; seed_provider=org.apache.cassandra.locator.SimpleSeedProvider{seeds=elassandra-0.elassandra.bigdata.svc.cluster.local}; server_encryption_options=; slow_query_log_timeout_in_ms=500; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_keep_alive_period_in_secs=300; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@10e41621; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=5000]
2018-05-09 16:01:50,744 INFO [main] org.apache.cassandra.config.DatabaseDescriptor.applySimpleConfig(DatabaseDescriptor.java:367) DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
2018-05-09 16:01:50,745 INFO [main] org.apache.cassandra.config.DatabaseDescriptor.applySimpleConfig(DatabaseDescriptor.java:425) Global memtable on-heap threshold is enabled at 2043MB
2018-05-09 16:01:50,746 INFO [main] org.apache.cassandra.config.DatabaseDescriptor.applySimpleConfig(DatabaseDescriptor.java:429) Global memtable off-heap threshold is enabled at 2043MB
2018-05-09 16:01:50,995 INFO [main] org.apache.cassandra.net.RateBasedBackPressure.(RateBasedBackPressure.java:123) Initialized back-pressure with high ratio: 0.9, factor: 5, flow: FAST, window size: 5000.
2018-05-09 16:01:50,996 INFO [main] org.apache.cassandra.config.DatabaseDescriptor.applySimpleConfig(DatabaseDescriptor.java:729) Back-pressure is disabled with strategy null.
2018-05-09 16:01:51,220 INFO [main] org.apache.cassandra.locator.GossipingPropertyFileSnitch.(GossipingPropertyFileSnitch.java:64) Loaded cassandra-topology.properties for compatibility
2018-05-09 16:01:56,313 INFO [ScheduledTasks:1] org.apache.cassandra.locator.TokenMetadata.updateTopology(TokenMetadata.java:498) Updating topology for all endpoints that have changed
2018-05-09 16:01:58,627 INFO [main] org.apache.cassandra.cql3.QueryProcessor.(QueryProcessor.java:116) Initialized prepared statement caches with 31 MB (native) and 31 MB (Thrift)
2018-05-09 16:01:59,970 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.IndexInfo
2018-05-09 16:02:01,729 INFO [SSTableBatchOpen:1] org.apache.cassandra.utils.memory.BufferPool$GlobalPool.(BufferPool.java:230) Global buffer pool is enabled, when pool is exhausted (max is 512.000MiB) it will allocate on heap
2018-05-09 16:02:02,075 INFO [main] org.apache.cassandra.service.CacheService.initKeyCache(CacheService.java:112) Initializing key cache with capacity of 100 MBs.
2018-05-09 16:02:02,091 INFO [main] org.apache.cassandra.service.CacheService.initRowCache(CacheService.java:134) Initializing row cache with capacity of 0 MBs
2018-05-09 16:02:02,099 INFO [main] org.apache.cassandra.service.CacheService.initCounterCache(CacheService.java:163) Initializing counter cache with capacity of 50 MBs
2018-05-09 16:02:02,111 INFO [main] org.apache.cassandra.service.CacheService.initCounterCache(CacheService.java:174) Scheduling counter cache save to every 7200 seconds (going to save all keys).
2018-05-09 16:02:02,198 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.batches
2018-05-09 16:02:02,236 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.paxos
2018-05-09 16:02:02,289 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.local
2018-05-09 16:02:02,329 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.peers
2018-05-09 16:02:02,373 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.peer_events
2018-05-09 16:02:02,384 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.range_xfers
2018-05-09 16:02:02,395 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.compaction_history
2018-05-09 16:02:02,421 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.sstable_activity
2018-05-09 16:02:02,452 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.size_estimates
2018-05-09 16:02:02,488 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.available_ranges
2018-05-09 16:02:02,504 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.transferred_ranges
2018-05-09 16:02:02,515 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.views_builds_in_progress
2018-05-09 16:02:02,523 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.built_views
2018-05-09 16:02:02,531 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.hints
2018-05-09 16:02:02,541 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.batchlog
2018-05-09 16:02:02,553 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.prepared_statements
2018-05-09 16:02:02,576 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.schema_keyspaces
2018-05-09 16:02:02,586 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.schema_columnfamilies
2018-05-09 16:02:02,594 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.schema_columns
2018-05-09 16:02:02,602 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.schema_triggers
2018-05-09 16:02:02,611 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.schema_usertypes
2018-05-09 16:02:02,619 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.schema_functions
2018-05-09 16:02:02,628 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system.schema_aggregates
2018-05-09 16:02:02,631 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace system as storage service is not initialized
2018-05-09 16:02:02,901 INFO [main] org.apache.cassandra.db.monitoring.ApproximateTime.(ApproximateTime.java:44) Scheduling approximate time-check task with a precision of 10 milliseconds
2018-05-09 16:02:08,354 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/QHR0roXvQ66LICG3aZltZA] no index state found - ignoring
2018-05-09 16:02:08,358 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/wQc51tfdQYCmPBffGmgykw] no index state found - ignoring
2018-05-09 16:02:08,360 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/Mw5gBIs8Q-2ZRp1REikJCA] no index state found - ignoring
2018-05-09 16:02:08,363 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/ntyLLHQwQmqAy0Kxd3dZfg] no index state found - ignoring
2018-05-09 16:02:08,365 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/nUIEpqJHR8eqweFbrp8hhA] no index state found - ignoring
2018-05-09 16:02:08,369 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/0A5Tb-GXQrSpmN1oeBDhQQ] no index state found - ignoring
2018-05-09 16:02:08,370 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/zUNifXgSRKyiSv_49_FWJg] no index state found - ignoring
2018-05-09 16:02:08,372 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/huOQhYWQT1WO90QXwADvsA] no index state found - ignoring
2018-05-09 16:02:08,379 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/60q4nNzrTqSqTd5ztckASw] no index state found - ignoring
2018-05-09 16:02:08,380 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/cRLgf28HRH-ygrOUywGCtQ] no index state found - ignoring
2018-05-09 16:02:08,381 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/PvumvsazTgyJnPisTHuRFA] no index state found - ignoring
2018-05-09 16:02:08,382 WARN [main] org.elasticsearch.common.util.IndexFolderUpgrader.upgrade(IndexFolderUpgrader.java:117) [/opt/elassandra-5.5.0.15/data/elasticsearch.data/nodes/0/indices/_a1JvbgAR3-NPZdRUzywAg] no index state found - ignoring
2018-05-09 16:02:09,090 INFO [main] org.apache.cassandra.utils.JMXServerUtils.logJmxServiceUrl(JMXServerUtils.java:246) Configured JMX server at: service:jmx:rmi://127.0.0.1/jndi/rmi://127.0.0.1:7199/jmxrmi
2018-05-09 16:02:09,119 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:481) Hostname: elassandra-0.elassandra.bigdata.svc.cluster.local
2018-05-09 16:02:09,120 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:488) JVM vendor/version: OpenJDK 64-Bit Server VM/1.8.0_162
2018-05-09 16:02:09,122 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:489) Heap size: 7.980GiB/7.980GiB
2018-05-09 16:02:09,123 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:494) Code Cache Non-heap memory: init = 2555904(2496K) used = 11208128(10945K) committed = 11403264(11136K) max = 251658240(245760K)
2018-05-09 16:02:09,124 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:494) Metaspace Non-heap memory: init = 0(0K) used = 59219680(57831K) committed = 62316544(60856K) max = -1(-1K)
2018-05-09 16:02:09,125 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:494) Compressed Class Space Non-heap memory: init = 0(0K) used = 8428504(8230K) committed = 9531392(9308K) max = 1073741824(1048576K)
2018-05-09 16:02:09,125 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:494) Par Eden Space Heap memory: init = 167772160(163840K) used = 167772160(163840K) committed = 167772160(163840K) max = 167772160(163840K)
2018-05-09 16:02:09,126 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:494) Par Survivor Space Heap memory: init = 20971520(20480K) used = 20971520(20480K) committed = 20971520(20480K) max = 20971520(20480K)
2018-05-09 16:02:09,140 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:494) CMS Old Gen Heap memory: init = 8380219392(8183808K) used = 23008080(22468K) committed = 8380219392(8183808K) max = 8380219392(8183808K)
2018-05-09 16:02:09,141 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:496) Classpath: /opt/elassandra-5.5.0.15/conf:/opt/elassandra-5.5.0.15/lib/HdrHistogram-2.1.9.jar:/opt/elassandra-5.5.0.15/lib/ST4-4.0.8.jar:/opt/elassandra-5.5.0.15/lib/airline-0.6.jar:/opt/elassandra-5.5.0.15/lib/ant-1.7.0.jar:/opt/elassandra-5.5.0.15/lib/ant-launcher-1.7.0.jar:/opt/elassandra-5.5.0.15/lib/antlr-3.5.2.jar:/opt/elassandra-5.5.0.15/lib/antlr-runtime-3.5.2.jar:/opt/elassandra-5.5.0.15/lib/caffeine-2.2.6.jar:/opt/elassandra-5.5.0.15/lib/cassandra-all-3.11.2.jar:/opt/elassandra-5.5.0.15/lib/cassandra-driver-core-3.0.1-shaded.jar:/opt/elassandra-5.5.0.15/lib/cassandra-thrift-3.11.2.jar:/opt/elassandra-5.5.0.15/lib/commons-cli-1.3.1.jar:/opt/elassandra-5.5.0.15/lib/commons-codec-1.10.jar:/opt/elassandra-5.5.0.15/lib/commons-lang3-3.3.1.jar:/opt/elassandra-5.5.0.15/lib/commons-logging-1.2.jar:/opt/elassandra-5.5.0.15/lib/commons-math3-3.2.jar:/opt/elassandra-5.5.0.15/lib/compress-lzf-0.8.4.jar:/opt/elassandra-5.5.0.15/lib/concurrent-trees-2.4.0.jar:/opt/elassandra-5.5.0.15/lib/concurrentlinkedhashmap-lru-1.4.jar:/opt/elassandra-5.5.0.15/lib/disruptor-3.0.1.jar:/opt/elassandra-5.5.0.15/lib/ecj-4.4.2.jar:/opt/elassandra-5.5.0.15/lib/elasticsearch-5.5.0.jar:/opt/elassandra-5.5.0.15/lib/fastutil-6.5.7.jar:/opt/elassandra-5.5.0.15/lib/guava-19.0.jar:/opt/elassandra-5.5.0.15/lib/hibernate-validator-4.3.0.Final.jar:/opt/elassandra-5.5.0.15/lib/high-scale-lib-1.0.6.jar:/opt/elassandra-5.5.0.15/lib/hppc-0.7.1.jar:/opt/elassandra-5.5.0.15/lib/httpclient-4.5.2.jar:/opt/elassandra-5.5.0.15/lib/httpcore-4.4.5.jar:/opt/elassandra-5.5.0.15/lib/jackson-core-2.8.6.jar:/opt/elassandra-5.5.0.15/lib/jackson-core-asl-1.9.13.jar:/opt/elassandra-5.5.0.15/lib/jackson-dataformat-cbor-2.8.6.jar:/opt/elassandra-5.5.0.15/lib/jackson-dataformat-smile-2.8.6.jar:/opt/elassandra-5.5.0.15/lib/jackson-dataformat-yaml-2.8.6.jar:/opt/elassandra-5.5.0.15/lib/jackson-mapper-asl-1.9.13.jar:/opt/elassandra-5.5.0.15/lib/java-version-checker-5.5.0.jar:/opt/elassandra-5.5.0.15/lib/javassist-3.20.0-GA.jar:/opt/elassandra-5.5.0.15/lib/javax.inject-1.jar:/opt/elassandra-5.5.0.15/lib/jbcrypt-0.3m.jar:/opt/elassandra-5.5.0.15/lib/jboss-logging-3.1.0.CR2.jar:/opt/elassandra-5.5.0.15/lib/jcl-over-slf4j-1.7.7.jar:/opt/elassandra-5.5.0.15/lib/jctools-core-1.2.1.jar:/opt/elassandra-5.5.0.15/lib/jflex-1.6.0.jar:/opt/elassandra-5.5.0.15/lib/jna-4.4.0.jar:/opt/elassandra-5.5.0.15/lib/joda-time-2.9.5.jar:/opt/elassandra-5.5.0.15/lib/jopt-simple-5.0.2.jar:/opt/elassandra-5.5.0.15/lib/json-simple-1.1.jar:/opt/elassandra-5.5.0.15/lib/jts-1.13.jar:/opt/elassandra-5.5.0.15/lib/libthrift-0.9.2.jar:/opt/elassandra-5.5.0.15/lib/log4j-api-2.8.2.jar:/opt/elassandra-5.5.0.15/lib/log4j-core-2.8.2.jar:/opt/elassandra-5.5.0.15/lib/log4j-over-slf4j-1.7.7.jar:/opt/elassandra-5.5.0.15/lib/log4j-to-slf4j-2.8.2.jar:/opt/elassandra-5.5.0.15/lib/logback-classic-1.1.8.jar:/opt/elassandra-5.5.0.15/lib/logback-core-1.1.8.jar:/opt/elassandra-5.5.0.15/lib/lucene-analyzers-common-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-backward-codecs-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-core-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-grouping-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-highlighter-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-join-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-memory-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-misc-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-queries-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-queryparser-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-sandbox-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-spatial-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-spatial-extras-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-spatial3d-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lucene-suggest-6.6.0.jar:/opt/elassandra-5.5.0.15/lib/lz4-1.3.0.jar:/opt/elassandra-5.5.0.15/lib/metrics-core-3.1.0.jar:/opt/elassandra-5.5.0.15/lib/metrics-jvm-3.1.0.jar:/opt/elassandra-5.5.0.15/lib/netty-all-4.1.12.Final.jar:/opt/elassandra-5.5.0.15/lib/ohc-core-0.4.4.jar:/opt/elassandra-5.5.0.15/lib/plugin-cli-5.5.0.jar:/opt/elassandra-5.5.0.15/lib/reporter-config-base-3.0.3.jar:/opt/elassandra-5.5.0.15/lib/reporter-config3-3.0.3.jar:/opt/elassandra-5.5.0.15/lib/securesm-1.1.jar:/opt/elassandra-5.5.0.15/lib/sigar-1.6.4.jar:/opt/elassandra-5.5.0.15/lib/slf4j-api-1.7.25.jar:/opt/elassandra-5.5.0.15/lib/snakeyaml-1.15.jar:/opt/elassandra-5.5.0.15/lib/snappy-java-1.1.1.7.jar:/opt/elassandra-5.5.0.15/lib/spatial4j-0.6.jar:/opt/elassandra-5.5.0.15/lib/stream-2.5.2.jar:/opt/elassandra-5.5.0.15/lib/t-digest-3.0.jar:/opt/elassandra-5.5.0.15/lib/thrift-server-0.3.7.jar:/opt/elassandra-5.5.0.15/lib/validation-api-1.0.0.GA.jar:/opt/elassandra-5.5.0.15/lib/jamm-0.3.0.jar
2018-05-09 16:02:09,147 INFO [main] org.apache.cassandra.service.CassandraDaemon.logSystemInfo(CassandraDaemon.java:498) JVM Arguments: [-Djava.library.path=/opt/elassandra-5.5.0.15/lib/sigar-bin, -Xloggc:/opt/elassandra-5.5.0.15/logs/gc.log, -ea, -XX:+UseThreadPriorities, -XX:ThreadPriorityPolicy=42, -XX:+HeapDumpOnOutOfMemoryError, -Xss256k, -XX:StringTableSize=1000003, -XX:+AlwaysPreTouch, -XX:-UseBiasedLocking, -XX:+UseTLAB, -XX:+ResizeTLAB, -XX:+UseNUMA, -XX:+PerfDisableSharedMem, -Djava.net.preferIPv4Stack=true, -XX:+UseParNewGC, -XX:+UseConcMarkSweepGC, -XX:+CMSParallelRemarkEnabled, -XX:SurvivorRatio=8, -XX:MaxTenuringThreshold=1, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:CMSWaitDuration=10000, -XX:+CMSParallelInitialMarkEnabled, -XX:+CMSEdenChunksRecordAlways, -XX:+CMSClassUnloadingEnabled, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintHeapAtGC, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -XX:+PrintPromotionFailure, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=10, -XX:GCLogFileSize=10M, -Xms8192M, -Xmx8192M, -Xmn200M, -XX:CompileCommandFile=/opt/elassandra-5.5.0.15/conf/hotspot_compiler, -javaagent:/opt/elassandra-5.5.0.15/lib/jamm-0.3.0.jar, -Dcassandra.jmx.local.port=7199, -Dcom.sun.management.jmxremote.authenticate=false, -Dcom.sun.management.jmxremote.password.file=/etc/cassandra/jmxremote.password, -Djava.library.path=/opt/elassandra-5.5.0.15/lib/sigar-bin, -Dfile.encoding=UTF-8, -Djna.nosys=true, -Djdk.io.permissionsUseCanonicalPath=true, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Dlog4j.skipJansi=true, -Dcassandra.libjemalloc=/usr/lib/x86_64-linux-gnu/libjemalloc.so.1, -Djava.awt.headless=true, -Dlogback.configurationFile=/opt/elassandra-5.5.0.15/conf/logback.xml, -Dcassandra.logdir=/var/log/cassandra, -Dcassandra.storagedir=/opt/elassandra-5.5.0.15/data, -Dcassandra-pidfile=/opt/elassandra-5.5.0.15/cassandra.pid, -Dcassandra-foreground=yes]
2018-05-09 16:02:09,471 INFO [main] org.apache.cassandra.utils.NativeLibrary.tryMlockall(NativeLibrary.java:174) JNA mlockall successful
2018-05-09 16:02:09,490 INFO [main] org.apache.cassandra.service.StartupChecks$1.execute(StartupChecks.java:140) jemalloc seems to be preloaded from /usr/lib/x86_64-linux-gnu/libjemalloc.so.1
2018-05-09 16:02:09,491 WARN [main] org.apache.cassandra.service.StartupChecks$3.execute(StartupChecks.java:169) JMX is not enabled to receive remote connections. Please see cassandra-env.sh for more info.
2018-05-09 16:02:09,496 WARN [main] org.apache.cassandra.service.StartupChecks$5.checkOutOfMemoryHandling(StartupChecks.java:220) The JVM is not configured to stop on OutOfMemoryError which can cause data corruption. Use one of the following JVM options to configure the behavior on OutOfMemoryError: -XX:+ExitOnOutOfMemoryError, -XX:+CrashOnOutOfMemoryError, or -XX:OnOutOfMemoryError=";"
2018-05-09 16:02:09,503 INFO [main] org.apache.cassandra.utils.SigarLibrary.(SigarLibrary.java:44) Initializing SIGAR library
OpenJDK 64-Bit Server VM warning: You have loaded library /opt/elassandra-5.5.0.15/lib/sigar-bin/libsigar-amd64-linux.so which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c ', or link it with '-z noexecstack'.
2018-05-09 16:02:09,534 INFO [main] org.apache.cassandra.utils.SigarLibrary.(SigarLibrary.java:57) Could not initialize SIGAR library org.hyperic.sigar.Sigar.getFileSystemListNative()[Lorg/hyperic/sigar/FileSystem;
2018-05-09 16:02:09,535 INFO [main] org.apache.cassandra.utils.SigarLibrary.warnIfRunningInDegradedMode(SigarLibrary.java:185) Sigar could not be initialized, test for checking degraded mode omitted.
2018-05-09 16:02:09,536 WARN [main] org.apache.cassandra.service.StartupChecks$8.execute(StartupChecks.java:311) Maximum number of memory map areas per process (vm.max_map_count) 65530 is too low, recommended value: 1048575, you can change it with sysctl.
2018-05-09 16:02:10,389 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.keyspaces
2018-05-09 16:02:10,470 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.tables
2018-05-09 16:02:10,541 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.columns
2018-05-09 16:02:10,616 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.triggers
2018-05-09 16:02:10,693 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.dropped_columns
2018-05-09 16:02:10,758 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.views
2018-05-09 16:02:10,838 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.types
2018-05-09 16:02:10,912 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.functions
2018-05-09 16:02:10,982 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.aggregates
2018-05-09 16:02:11,175 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_schema.indexes
2018-05-09 16:02:11,194 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace system_schema as storage service is not initialized
2018-05-09 16:02:12,022 INFO [main] org.apache.cassandra.service.StorageService.populateTokenMetadata(StorageService.java:600) Populating token metadata from system tables
2018-05-09 16:02:12,086 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -8362130585556172891 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:12,087 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 6791530300178346392 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:12,088 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -959123631124296270 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:12,089 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -2906258939937529727 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:12,090 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 5701683067600102763 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:12,092 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 7776769257334882293 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:12,092 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 3566883655066165006 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:12,093 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 5633264194489195507 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:12,100 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -362226123124935217 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:12,101 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 8401438299379969757 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:12,105 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 6275689832852561075 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:12,109 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 4451716466158730928 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:12,111 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -6090579284089889517 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:12,114 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 4631534558835767927 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:12,115 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 8914019774812791023 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:12,116 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -8592977458636693389 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:12,117 INFO [main] org.apache.cassandra.service.StorageService.populateTokenMetadata(StorageService.java:607) Token metadata: Normal Tokens:
/10.233.90.28:[-8362130585556172891, -2906258939937529727, -959123631124296270, 3566883655066165006, 5633264194489195507, 5701683067600102763, 6791530300178346392, 7776769257334882293]
/10.233.97.141:[-8248027387514132260, -7318731352128861107, -861916047897630515, 3049595437829094990, 3681862537357852614, 7941763563148319339, 8234545346034199838, 9073971229396420877]
/10.233.114.185:[-9048183706652428987, -5086691515524827064, -4260497491636981485, -4164481151685738517, -1054867843544454931, 4437679225950754397, 5141005615383236012, 6372063045572782995]
/10.233.117.217:[-7227302454714817399, -5939375512383729793, -2206250258799490034, 1732568509439143634, 2600887383460939089, 4748189529193459068, 8796692000955143727, 9083020370715658495]
/10.233.121.123:[-3299701738014063480, -2539197605680580109, -1839508776458638598, -118864622025183534, 1111019062840381676, 6132333345085630748, 6774441214942613853, 8907766337491345741]
/10.233.122.175:[-8592977458636693389, -6090579284089889517, -362226123124935217, 4451716466158730928, 4631534558835767927, 6275689832852561075, 8401438299379969757, 8914019774812791023]
2018-05-09 16:02:13,068 INFO [main] org.apache.cassandra.service.ElassandraDaemon.activateAndWaitShards(ElassandraDaemon.java:366) Activating Elasticsearch, shards starting before opening user keyspaces 2018-05-09 16:02:13,546 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.wmsskuet' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:13,546 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.wmsskuet' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,025 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.carrierperf' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,026 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.carrierperf' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,084 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.bob_v1' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,085 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.bob_v1' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,134 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.prdedi' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,135 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.prdedi' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,195 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.gtnx_shipment_v2' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,196 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.gtnx_shipment_v2' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,321 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.gtnx_shipment_v1' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,322 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.gtnx_shipment_v1' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,416 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.driverperf_v1' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,417 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.driverperf_v1' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,551 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.gtnx_purchase_order' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,559 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.gtnx_purchase_order' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,712 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query..kibana' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,735 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch..kibana' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,975 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.twitter' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:14,975 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.twitter' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:15,034 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.query.poc_training' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:15,051 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.apache.cassandra.service.StorageService.setLoggingLevel(StorageService.java:3846) set log level to TRACE for classes under 'index.search.slowlog.fetch.poc_training' (if the level doesn't look like 'TRACE' then the logger couldn't parse 'TRACE') 2018-05-09 16:02:15,302 INFO [elasticsearch[10.233.117.217][clusterService#updateTask][T#1]] org.elassandra.gateway.CassandraGatewayService$GatewayRecoveryListener$1.clusterStateProcessed(CassandraGatewayService.java:134) Recovered [11] indices into cluster_state 2018-05-09 16:02:15,312 INFO [main] org.apache.cassandra.service.ElassandraDaemon.activateAndWaitShards(ElassandraDaemon.java:370) Elasticsearch shards started, ready to go on. 2018-05-09 16:02:15,850 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing driverperf.driverperf
2018-05-09 16:02:15,907 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace driverperf as storage service is not initialized
2018-05-09 16:02:15,937 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_traces.events
2018-05-09 16:02:15,966 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_traces.sessions
2018-05-09 16:02:15,983 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace system_traces as storage service is not initialized
2018-05-09 16:02:16,002 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing wmsskuet.wmsskuet
2018-05-09 16:02:16,331 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[wmsskuet.wmsskuet] hashCode=1279536741 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:16,337 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace wmsskuet as storage service is not initialized
2018-05-09 16:02:16,350 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[wmsskuet.wmsskuet] initialized, metadata.version=128 mappingInfo.indices=wmsskuet typeName=wmsskuet
2018-05-09 16:02:16,407 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing twitter.tweet
2018-05-09 16:02:16,432 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[twitter.tweet] hashCode=1590802853 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:16,434 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[twitter.tweet] initialized, metadata.version=128 mappingInfo.indices=twitter typeName=tweet
2018-05-09 16:02:16,468 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing twitter.user
2018-05-09 16:02:16,510 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[twitter.user] hashCode=329594950 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:16,512 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[twitter.user] initialized, metadata.version=128 mappingInfo.indices=twitter typeName=user
2018-05-09 16:02:16,515 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace twitter as storage service is not initialized
2018-05-09 16:02:16,544 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_distributed.parent_repair_history
2018-05-09 16:02:16,594 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_distributed.repair_history
2018-05-09 16:02:16,642 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_distributed.view_build_status
2018-05-09 16:02:16,648 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace system_distributed as storage service is not initialized
2018-05-09 16:02:16,686 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing prdedi.prdedi
2018-05-09 16:02:17,100 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[prdedi.prdedi] hashCode=964590191 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,102 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[prdedi.prdedi] initialized, metadata.version=128 mappingInfo.indices=prdedi typeName=prdedi
2018-05-09 16:02:17,105 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace prdedi as storage service is not initialized
2018-05-09 16:02:17,124 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing gtnx_shipment_v2.gtnx_shipment_v2
2018-05-09 16:02:17,140 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[gtnx_shipment_v2.gtnx_shipment_v2] hashCode=179287420 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,144 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[gtnx_shipment_v2.gtnx_shipment_v2] initialized, metadata.version=128 mappingInfo.indices=gtnx_shipment_v2 typeName=gtnx_shipment_v2
2018-05-09 16:02:17,145 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace gtnx_shipment_v2 as storage service is not initialized
2018-05-09 16:02:17,182 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing gtnx_purchase_order.gtnx_purchase_order
2018-05-09 16:02:17,229 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[gtnx_purchase_order.gtnx_purchase_order] hashCode=1507866909 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,232 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[gtnx_purchase_order.gtnx_purchase_order] initialized, metadata.version=128 mappingInfo.indices=gtnx_purchase_order typeName=gtnx_purchase_order
2018-05-09 16:02:17,234 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace gtnx_purchase_order as storage service is not initialized
2018-05-09 16:02:17,254 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing driverperf_2.driverperf_2
2018-05-09 16:02:17,272 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace driverperf_2 as storage service is not initialized
2018-05-09 16:02:17,322 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing gtnx_shipment_v1.gtnx_shipment_v1
2018-05-09 16:02:17,349 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[gtnx_shipment_v1.gtnx_shipment_v1] hashCode=1673354607 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,352 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[gtnx_shipment_v1.gtnx_shipment_v1] initialized, metadata.version=128 mappingInfo.indices=gtnx_shipment_v1 typeName=gtnx_shipment_v1
2018-05-09 16:02:17,354 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace gtnx_shipment_v1 as storage service is not initialized
2018-05-09 16:02:17,378 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing _kibana.config
2018-05-09 16:02:17,407 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[_kibana.config] hashCode=702217845 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,409 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[_kibana.config] initialized, metadata.version=128 mappingInfo.indices=.kibana typeName=config
2018-05-09 16:02:17,428 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing _kibana.dashboard
2018-05-09 16:02:17,435 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[_kibana.dashboard] hashCode=1588181607 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,437 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[_kibana.dashboard] initialized, metadata.version=128 mappingInfo.indices=.kibana typeName=dashboard
2018-05-09 16:02:17,480 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing _kibana.index_pattern
2018-05-09 16:02:17,527 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[_kibana.index_pattern] hashCode=114907262 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,529 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[_kibana.index_pattern] initialized, metadata.version=128 mappingInfo.indices=.kibana typeName=index-pattern
2018-05-09 16:02:17,542 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing _kibana.search
2018-05-09 16:02:17,563 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[_kibana.search] hashCode=252066799 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,565 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[_kibana.search] initialized, metadata.version=128 mappingInfo.indices=.kibana typeName=search
2018-05-09 16:02:17,585 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing _kibana.server
2018-05-09 16:02:17,593 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[_kibana.server] hashCode=1901151532 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,595 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[_kibana.server] initialized, metadata.version=128 mappingInfo.indices=.kibana typeName=server
2018-05-09 16:02:17,610 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing _kibana.timelion_sheet
2018-05-09 16:02:17,633 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[_kibana.timelion_sheet] hashCode=1656271843 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,635 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[_kibana.timelion_sheet] initialized, metadata.version=128 mappingInfo.indices=.kibana typeName=timelion-sheet
2018-05-09 16:02:17,646 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing _kibana.url
2018-05-09 16:02:17,654 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[_kibana.url] hashCode=787357026 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,655 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[_kibana.url] initialized, metadata.version=128 mappingInfo.indices=.kibana typeName=url
2018-05-09 16:02:17,671 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing _kibana.visualization
2018-05-09 16:02:17,681 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace _kibana as storage service is not initialized
2018-05-09 16:02:17,681 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[_kibana.visualization] hashCode=269062675 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:17,683 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[_kibana.visualization] initialized, metadata.version=128 mappingInfo.indices=.kibana typeName=visualization
2018-05-09 16:02:17,717 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing elastic_admin.metadata
2018-05-09 16:02:17,977 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace elastic_admin as storage service is not initialized
2018-05-09 16:02:18,015 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing driverperf_v1.driverperf_v1
2018-05-09 16:02:18,086 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[driverperf_v1.driverperf_v1] hashCode=1804262683 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:18,086 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace driverperf_v1 as storage service is not initialized
2018-05-09 16:02:18,088 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[driverperf_v1.driverperf_v1] initialized, metadata.version=128 mappingInfo.indices=driverperf_v1 typeName=driverperf_v1
2018-05-09 16:02:18,129 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing carrierperf.carrierperf
2018-05-09 16:02:18,330 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[carrierperf.carrierperf] hashCode=1284135970 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:18,330 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace carrierperf as storage service is not initialized
2018-05-09 16:02:18,337 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[carrierperf.carrierperf] initialized, metadata.version=128 mappingInfo.indices=carrierperf typeName=carrierperf
2018-05-09 16:02:18,364 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing bob_v1.bob_v1
2018-05-09 16:02:18,375 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace bob_v1 as storage service is not initialized
2018-05-09 16:02:18,375 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[bob_v1.bob_v1] hashCode=307322332 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:18,379 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[bob_v1.bob_v1] initialized, metadata.version=128 mappingInfo.indices=bob_v1 typeName=bob_v1
2018-05-09 16:02:18,392 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_auth.resource_role_permissons_index
2018-05-09 16:02:18,401 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_auth.role_members
2018-05-09 16:02:18,420 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_auth.role_permissions
2018-05-09 16:02:18,444 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing system_auth.roles
2018-05-09 16:02:18,455 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace system_auth as storage service is not initialized
2018-05-09 16:02:18,501 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing poc_training.data
2018-05-09 16:02:18,518 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[poc_training.data] hashCode=1309990031 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:18,520 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[poc_training.data] initialized, metadata.version=128 mappingInfo.indices=poc_training typeName=data
2018-05-09 16:02:18,526 INFO [main] org.apache.cassandra.db.ColumnFamilyStore.(ColumnFamilyStore.java:411) Initializing poc_training.poc_training
2018-05-09 16:02:18,530 INFO [main] org.apache.cassandra.db.view.ViewManager.reload(ViewManager.java:137) Not submitting build tasks for views in keyspace poc_training as storage service is not initialized
2018-05-09 16:02:18,530 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initialize(ElasticSecondaryIndex.java:2166) Initializing elastic secondary index=[poc_training.poc_training] hashCode=1934340691 initCounter=1 metadata.version=128 indices=[wmsskuet=>wmsskuet/wmsskuet, carrierperf=>carrierperf/carrierperf, bob_v1=>bob_v1/bob_v1, prdedi=>prdedi/prdedi, gtnx_shipment_v2=>gtnx_shipment_v2/gtnx_shipment_v2, gtnx_shipment_v1=>gtnx_shipment_v1/gtnx_shipment_v1, driverperf_v1=>driverperf_v1/driverperf_v1, gtnx_purchase_order=>gtnx_purchase_order/gtnx_purchase_order, .kibana=>.kibana/_kibana, twitter=>twitter/twitter, poc_training=>poc_training/poc_training]
2018-05-09 16:02:18,532 INFO [SecondaryIndexManagement:1] org.elassandra.index.ElasticSecondaryIndex.initMapping(ElasticSecondaryIndex.java:2098) Secondary index=[poc_training.poc_training] initialized, metadata.version=128 mappingInfo.indices=poc_training typeName=poc_training
2018-05-09 16:02:18,607 INFO [pool-5-thread-1] org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:197) reading saved cache /opt/elassandra-5.5.0.15/data/saved_caches/KeyCache-e.db
2018-05-09 16:02:18,648 INFO [pool-5-thread-1] org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:262) Harmless error reading saved cache /opt/elassandra-5.5.0.15/data/saved_caches/KeyCache-e.db
java.lang.RuntimeException: Cache schema version f6b19ed5-914c-3f76-978e-b81754b6ccdf does not match current schema version 6baf79fa-364d-3ad2-bc9a-b75ba1b215ec
at org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:206)
at org.apache.cassandra.cache.AutoSavingCache$3.call(AutoSavingCache.java:164)
at org.apache.cassandra.cache.AutoSavingCache$3.call(AutoSavingCache.java:160)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:108)
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:41)
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:77)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-05-09 16:02:18,653 INFO [pool-5-thread-1] org.apache.cassandra.cache.AutoSavingCache$4.run(AutoSavingCache.java:173) Completed loading (90 ms; 107 keys) KeyCache cache
2018-05-09 16:02:18,712 INFO [main] org.apache.cassandra.db.commitlog.CommitLog.recoverSegmentsOnDisk(CommitLog.java:157) Replaying /opt/elassandra-5.5.0.15/data/commitlog/CommitLog-6-1525881647282.log
2018-05-09 16:02:18,884 INFO [main] org.apache.cassandra.db.commitlog.CommitLog.recoverSegmentsOnDisk(CommitLog.java:159) Log replay complete, 0 replayed mutations
2018-05-09 16:02:18,889 INFO [main] org.apache.cassandra.service.StorageService.populateTokenMetadata(StorageService.java:600) Populating token metadata from system tables
2018-05-09 16:02:18,926 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -8362130585556172891 changing ownership from /10.233.90.28 to /10.233.90.25
2018-05-09 16:02:18,935 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 6791530300178346392 changing ownership from /10.233.90.28 to /10.233.90.25
2018-05-09 16:02:18,936 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -959123631124296270 changing ownership from /10.233.90.28 to /10.233.90.25
2018-05-09 16:02:18,936 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -2906258939937529727 changing ownership from /10.233.90.28 to /10.233.90.25
2018-05-09 16:02:18,937 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 5701683067600102763 changing ownership from /10.233.90.28 to /10.233.90.25
2018-05-09 16:02:18,937 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 7776769257334882293 changing ownership from /10.233.90.28 to /10.233.90.25
2018-05-09 16:02:18,938 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 3566883655066165006 changing ownership from /10.233.90.28 to /10.233.90.25
2018-05-09 16:02:18,938 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 5633264194489195507 changing ownership from /10.233.90.28 to /10.233.90.25
2018-05-09 16:02:18,939 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -362226123124935217 changing ownership from /10.233.122.175 to /10.233.122.168
2018-05-09 16:02:18,940 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 8401438299379969757 changing ownership from /10.233.122.175 to /10.233.122.168
2018-05-09 16:02:18,941 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 6275689832852561075 changing ownership from /10.233.122.175 to /10.233.122.168
2018-05-09 16:02:18,943 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 4451716466158730928 changing ownership from /10.233.122.175 to /10.233.122.168
2018-05-09 16:02:18,943 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -6090579284089889517 changing ownership from /10.233.122.175 to /10.233.122.168
2018-05-09 16:02:18,946 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 4631534558835767927 changing ownership from /10.233.122.175 to /10.233.122.168
2018-05-09 16:02:18,947 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 8914019774812791023 changing ownership from /10.233.122.175 to /10.233.122.168
2018-05-09 16:02:18,947 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -8592977458636693389 changing ownership from /10.233.122.175 to /10.233.122.168
2018-05-09 16:02:18,948 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -8362130585556172891 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:18,948 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 6791530300178346392 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:18,949 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -959123631124296270 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:18,950 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -2906258939937529727 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:18,951 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 5701683067600102763 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:18,952 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 7776769257334882293 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:18,952 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 3566883655066165006 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:18,952 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 5633264194489195507 changing ownership from /10.233.90.25 to /10.233.90.28
2018-05-09 16:02:18,960 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -362226123124935217 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:18,960 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 8401438299379969757 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:18,961 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 6275689832852561075 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:18,961 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 4451716466158730928 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:18,961 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -6090579284089889517 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:18,962 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 4631534558835767927 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:18,962 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token 8914019774812791023 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:18,962 WARN [main] org.apache.cassandra.locator.TokenMetadata.updateNormalTokens(TokenMetadata.java:215) Token -8592977458636693389 changing ownership from /10.233.122.168 to /10.233.122.175
2018-05-09 16:02:18,962 INFO [main] org.apache.cassandra.service.StorageService.populateTokenMetadata(StorageService.java:607) Token metadata: Normal Tokens:
/10.233.90.28:[-8362130585556172891, -2906258939937529727, -959123631124296270, 3566883655066165006, 5633264194489195507, 5701683067600102763, 6791530300178346392, 7776769257334882293]
/10.233.97.141:[-8248027387514132260, -7318731352128861107, -861916047897630515, 3049595437829094990, 3681862537357852614, 7941763563148319339, 8234545346034199838, 9073971229396420877]
/10.233.114.185:[-9048183706652428987, -5086691515524827064, -4260497491636981485, -4164481151685738517, -1054867843544454931, 4437679225950754397, 5141005615383236012, 6372063045572782995]
/10.233.117.217:[-7227302454714817399, -5939375512383729793, -2206250258799490034, 1732568509439143634, 2600887383460939089, 4748189529193459068, 8796692000955143727, 9083020370715658495]
/10.233.121.123:[-3299701738014063480, -2539197605680580109, -1839508776458638598, -118864622025183534, 1111019062840381676, 6132333345085630748, 6774441214942613853, 8907766337491345741]
/10.233.122.175:[-8592977458636693389, -6090579284089889517, -362226123124935217, 4451716466158730928, 4631534558835767927, 6275689832852561075, 8401438299379969757, 8914019774812791023]
2018-05-09 16:02:19,376 INFO [main] org.apache.cassandra.cql3.QueryProcessor.preloadPreparedStatement(QueryProcessor.java:163) Preloaded 9 prepared statements 2018-05-09 16:02:19,388 INFO [main] org.apache.cassandra.service.StorageService.initServer(StorageService.java:618) Cassandra version: 3.11.2 2018-05-09 16:02:19,391 INFO [main] org.apache.cassandra.service.StorageService.initServer(StorageService.java:619) Thrift API version: 20.1.0 2018-05-09 16:02:19,392 INFO [main] org.apache.cassandra.service.StorageService.initServer(StorageService.java:620) CQL supported versions: 3.4.4 (default: 3.4.4) 2018-05-09 16:02:19,392 INFO [main] org.apache.cassandra.service.StorageService.initServer(StorageService.java:622) Native protocol supported versions: 3/v3, 4/v4, 5/v5-beta (default: 4/v4) 2018-05-09 16:02:19,592 INFO [main] org.apache.cassandra.io.sstable.IndexSummaryManager.(IndexSummaryManager.java:85) Initializing index summary manager with a memory pool size of 408 MB and a resize interval of 60 minutes
2018-05-09 16:02:19,623 INFO [main] org.apache.cassandra.net.MessagingService.getServerSockets(MessagingService.java:753) Starting Messaging Service on /10.233.117.217:7000 (eth0)
2018-05-09 16:02:19,657 INFO [main] org.apache.cassandra.service.StorageService.loadRingState(StorageService.java:707) Loading persisted ring state
2018-05-09 16:02:19,670 INFO [main] org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:825) Starting up server gossip
2018-05-09 16:02:19,907 INFO [main] org.apache.cassandra.locator.TokenMetadata.updateTopology(TokenMetadata.java:479) Updating topology for /10.233.117.217
2018-05-09 16:02:19,911 INFO [main] org.apache.cassandra.locator.TokenMetadata.updateTopology(TokenMetadata.java:479) Updating topology for /10.233.117.217
2018-05-09 16:02:20,131 INFO [main] org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:994) Using saved tokens [-2206250258799490034, -5939375512383729793, -7227302454714817399, 1732568509439143634, 2600887383460939089, 4748189529193459068, 8796692000955143727, 9083020370715658495]
2018-05-09 16:02:20,191 INFO [main] org.apache.cassandra.service.StorageService.setMode(StorageService.java:1455) JOINING: Finish joining ring
2018-05-09 16:02:20,275 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='driverperf', ColumnFamily='driverperf')
2018-05-09 16:02:20,281 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='wmsskuet', ColumnFamily='wmsskuet')
2018-05-09 16:02:20,284 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='twitter', ColumnFamily='user')
2018-05-09 16:02:20,287 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='twitter', ColumnFamily='tweet')
2018-05-09 16:02:20,292 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='prdedi', ColumnFamily='prdedi')
2018-05-09 16:02:20,299 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='gtnx_shipment_v2', ColumnFamily='gtnx_shipment_v2')
2018-05-09 16:02:20,303 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='gtnx_purchase_order', ColumnFamily='gtnx_purchase_order')
2018-05-09 16:02:20,311 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='driverperf_2', ColumnFamily='driverperf_2')
2018-05-09 16:02:20,312 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='gtnx_shipment_v1', ColumnFamily='gtnx_shipment_v1')
2018-05-09 16:02:20,314 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='_kibana', ColumnFamily='config')
2018-05-09 16:02:20,319 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='_kibana', ColumnFamily='dashboard')
2018-05-09 16:02:20,322 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='_kibana', ColumnFamily='index_pattern')
2018-05-09 16:02:20,322 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='_kibana', ColumnFamily='search')
2018-05-09 16:02:20,326 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='_kibana', ColumnFamily='server')
2018-05-09 16:02:20,332 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='_kibana', ColumnFamily='url')
2018-05-09 16:02:20,338 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='_kibana', ColumnFamily='visualization')
2018-05-09 16:02:20,339 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='_kibana', ColumnFamily='timelion_sheet')
2018-05-09 16:02:20,339 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='elastic_admin', ColumnFamily='metadata')
2018-05-09 16:02:20,340 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='driverperf_v1', ColumnFamily='driverperf_v1')
2018-05-09 16:02:20,340 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='carrierperf', ColumnFamily='carrierperf')
2018-05-09 16:02:20,342 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='bob_v1', ColumnFamily='bob_v1')
2018-05-09 16:02:20,342 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='poc_training', ColumnFamily='data')
2018-05-09 16:02:20,347 INFO [main] org.apache.cassandra.index.SecondaryIndexManager.executePreJoinTasksBlocking(SecondaryIndexManager.java:518) Executing pre-join tasks for: CFS(Keyspace='poc_training', ColumnFamily='poc_training')
2018-05-09 16:02:20,419 INFO [main] org.apache.cassandra.service.StorageService.handleStateNormal(StorageService.java:2303) Node /10.233.117.217 state jump to NORMAL
2018-05-09 16:02:20,486 INFO [main] org.apache.cassandra.gms.Gossiper.waitToSettle(Gossiper.java:1670) Waiting for gossip to settle...
2018-05-09 16:02:20,912 INFO [GossipTasks:1] org.apache.cassandra.net.OutboundTcpConnection.(OutboundTcpConnection.java:108) OutboundTcpConnection using coalescing strategy DISABLED
2018-05-09 16:02:28,488 INFO [main] org.apache.cassandra.gms.Gossiper.waitToSettle(Gossiper.java:1701) No gossip backlog; proceeding
2018-05-09 16:02:28,704 INFO [main] org.apache.cassandra.service.NativeTransportService.initialize(NativeTransportService.java:75) Netty using Java NIO event loop
2018-05-09 16:02:28,799 INFO [main] org.apache.cassandra.transport.Server.start(Server.java:155) Using Netty Version: [netty-buffer=netty-buffer-4.1.12.Final.3acd5c68ea, netty-codec=netty-codec-4.1.12.Final.3acd5c68ea, netty-codec-dns=netty-codec-dns-4.1.12.Final.3acd5c68ea, netty-codec-haproxy=netty-codec-haproxy-4.1.12.Final.3acd5c68ea, netty-codec-http=netty-codec-http-4.1.12.Final.3acd5c68ea, netty-codec-http2=netty-codec-http2-4.1.12.Final.3acd5c68ea, netty-codec-memcache=netty-codec-memcache-4.1.12.Final.3acd5c68ea, netty-codec-mqtt=netty-codec-mqtt-4.1.12.Final.3acd5c68ea, netty-codec-redis=netty-codec-redis-4.1.12.Final.3acd5c68ea, netty-codec-smtp=netty-codec-smtp-4.1.12.Final.3acd5c68ea, netty-codec-socks=netty-codec-socks-4.1.12.Final.3acd5c68ea, netty-codec-stomp=netty-codec-stomp-4.1.12.Final.3acd5c68ea, netty-codec-xml=netty-codec-xml-4.1.12.Final.3acd5c68ea, netty-common=netty-common-4.1.12.Final.3acd5c68ea, netty-handler=netty-handler-4.1.12.Final.3acd5c68ea, netty-handler-proxy=netty-handler-proxy-4.1.12.Final.3acd5c68ea, netty-resolver=netty-resolver-4.1.12.Final.3acd5c68ea, netty-resolver-dns=netty-resolver-dns-4.1.12.Final.3acd5c68ea, netty-tcnative=netty-tcnative-2.0.3.Final.c3e60ce, netty-transport=netty-transport-4.1.12.Final.3acd5c68ea, netty-transport-native-epoll=netty-transport-native-epoll-4.1.12.Final.3acd5c6, netty-transport-native-kqueue=netty-transport-native-kqueue-4.1.12.Final.3acd5c68ea, netty-transport-native-unix-common=netty-transport-native-unix-common-4.1.12.Final.3acd5c68ea, netty-transport-rxtx=netty-transport-rxtx-4.1.12.Final.3acd5c68ea, netty-transport-sctp=netty-transport-sctp-4.1.12.Final.3acd5c68ea, netty-transport-udt=netty-transport-udt-4.1.12.Final.3acd5c68ea]
2018-05-09 16:02:28,800 INFO [main] org.apache.cassandra.transport.Server.start(Server.java:156) Starting listening for CQL clients on /0.0.0.0:9042 (unencrypted)...
2018-05-09 16:02:28,816 INFO [main] org.apache.cassandra.service.CassandraDaemon.start(CassandraDaemon.java:537) Not starting RPC server as requested. Use JMX (StorageService->startRPCServer()) or nodetool (enablethrift) to start it
2018-05-09 16:02:28,822 INFO [main] org.elassandra.discovery.CassandraDiscovery.doStart(CassandraDiscovery.java:153) localNode name=10.233.117.217 id=ab90840a-5ed7-45d7-b816-6545f5103ac5 localAddress=/10.233.117.217 publish_host=10.233.117.217:9300
{5.5.0}: Initialization Failed ...