Closed k8s-github-robot closed 7 years ago
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4249/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-qfsm7] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4203e76b0 exit status 1 <nil> <nil> true [0xc4202628a8 0xc4202628c0 0xc4202628d8] [0xc4202628a8 0xc4202628c0 0xc4202628d8] [0xc4202628b8 0xc4202628d0] [0xc37850 0xc37850] 0xc4210fd4a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-qfsm7] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4203e76b0 exit status 1 <nil> <nil> true [0xc4202628a8 0xc4202628c0 0xc4202628d8] [0xc4202628a8 0xc4202628c0 0xc4202628d8] [0xc4202628b8 0xc4202628d0] [0xc37850 0xc37850] 0xc4210fd4a0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4208c0440>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 08:55:51.290 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-sl590 with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-18 08:55:51.312 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 08:55:51.459 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 08:55:51 GMT 2017]; root of context hierarchy\n2017-03-18 08:55:53.395 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 08:55:53.417 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 08:55:54.040 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 08:55:54.158 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.21]\n2017-03-18 08:55:54.158 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 08:55:54.172 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 08:55:54.211 INFO 7 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.21]:5701\n2017-03-18 08:55:54.212 INFO 7 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 08:55:54.213 INFO 7 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 08:55:54.697 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.21]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 08:55:55.612 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.3.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 08:55:55.922 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 08:55:55.937 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 08:55:55.953 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTING\n2017-03-18 08:55:55.957 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 08:55:56.013 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.21]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.21]:5701 - bfdf32a4-4fd5-4136-be31-9d1ffdd1665b this\n}\n\n2017-03-18 08:55:56.091 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTED\n2017-03-18 08:55:56.099 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.839 seconds (JVM running for 6.848)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 08:55:51.290 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-sl590 with PID 7 (/bootstrapper.jar started by root in /)
2017-03-18 08:55:51.312 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 08:55:51.459 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 08:55:51 GMT 2017]; root of context hierarchy
2017-03-18 08:55:53.395 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 08:55:53.417 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 08:55:54.040 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 08:55:54.158 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.21]
2017-03-18 08:55:54.158 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 08:55:54.172 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 08:55:54.211 INFO 7 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.21]:5701
2017-03-18 08:55:54.212 INFO 7 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 08:55:54.213 INFO 7 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 08:55:54.697 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.21]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 08:55:55.612 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.3.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 08:55:55.922 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 08:55:55.937 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 08:55:55.953 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTING
2017-03-18 08:55:55.957 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 08:55:56.013 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.21]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.21]:5701 - bfdf32a4-4fd5-4136-be31-9d1ffdd1665b this
}
2017-03-18 08:55:56.091 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTED
2017-03-18 08:55:56.099 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.839 seconds (JVM running for 6.848)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421148550>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-4kwx5\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 09:11:04 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 09:11:04 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4kwx5}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 09:11:04 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 09:11:04 Global memtable on-heap threshold is enabled at 128MB\nINFO 09:11:04 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:11:04 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.13
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-4kwx5
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 09:11:04 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 09:11:04 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4kwx5}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 09:11:04 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 09:11:04 Global memtable on-heap threshold is enabled at 128MB
INFO 09:11:04 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 09:11:04 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4250/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc42145dfd0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-32j32\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 09:55:05 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 09:55:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-32j32}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 09:55:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 09:55:05 Global memtable on-heap threshold is enabled at 128MB\nINFO 09:55:05 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:55:05 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.8
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.8
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.8
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-32j32
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 09:55:05 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 09:55:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-32j32}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 09:55:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 09:55:05 Global memtable on-heap threshold is enabled at 128MB
INFO 09:55:05 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 09:55:05 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4212e4210>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 09:57:39.447 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-nv4g5 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 09:57:39.457 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 09:57:39.554 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 09:57:39 GMT 2017]; root of context hierarchy\n2017-03-18 09:57:41.300 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 09:57:41.319 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 09:57:41.899 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 09:57:42.011 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.9]\n2017-03-18 09:57:42.011 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 09:57:42.022 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 09:57:42.056 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.9]:5701\n2017-03-18 09:57:42.056 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 09:57:42.056 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 09:57:42.419 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 09:57:43.288 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 09:57:43.537 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 09:57:43.548 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 09:57:43.571 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTING\n2017-03-18 09:57:43.578 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 09:57:43.599 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.9]:5701 - 3ad1c0db-a408-41b1-9ca2-df9b5c1bf48a this\n}\n\n2017-03-18 09:57:43.670 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTED\n2017-03-18 09:57:43.673 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.198 seconds (JVM running for 6.075)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 09:57:39.447 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-nv4g5 with PID 6 (/bootstrapper.jar started by root in /)
2017-03-18 09:57:39.457 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 09:57:39.554 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 09:57:39 GMT 2017]; root of context hierarchy
2017-03-18 09:57:41.300 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 09:57:41.319 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 09:57:41.899 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 09:57:42.011 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.9]
2017-03-18 09:57:42.011 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 09:57:42.022 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 09:57:42.056 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.9]:5701
2017-03-18 09:57:42.056 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 09:57:42.056 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 09:57:42.419 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 09:57:43.288 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 09:57:43.537 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 09:57:43.548 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 09:57:43.571 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTING
2017-03-18 09:57:43.578 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 09:57:43.599 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.9]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.9]:5701 - 3ad1c0db-a408-41b1-9ca2-df9b5c1bf48a this
}
2017-03-18 09:57:43.670 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTED
2017-03-18 09:57:43.673 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.198 seconds (JVM running for 6.075)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.205.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-bmn61] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42135d080 exit status 1 <nil> <nil> true [0xc420e62208 0xc420e62220 0xc420e62238] [0xc420e62208 0xc420e62220 0xc420e62238] [0xc420e62218 0xc420e62230] [0xc37850 0xc37850] 0xc420dad320 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.205.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-bmn61] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42135d080 exit status 1 <nil> <nil> true [0xc420e62208 0xc420e62220 0xc420e62238] [0xc420e62208 0xc420e62220 0xc420e62238] [0xc420e62218 0xc420e62230] [0xc37850 0xc37850] 0xc420dad320 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4251/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420a55b40>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-786bk\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 10:57:53 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 10:57:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-786bk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 10:57:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 10:57:53 Global memtable on-heap threshold is enabled at 128MB\nINFO 10:57:53 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 10:57:53 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.7
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.7
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.7
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-786bk
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 10:57:53 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 10:57:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-786bk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 10:57:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 10:57:53 Global memtable on-heap threshold is enabled at 128MB
INFO 10:57:53 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 10:57:53 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l21g5] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42172cab0 exit status 1 <nil> <nil> true [0xc42027a730 0xc42027a778 0xc42027a7a8] [0xc42027a730 0xc42027a778 0xc42027a7a8] [0xc42027a760 0xc42027a790] [0xc37850 0xc37850] 0xc4210ca720 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l21g5] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42172cab0 exit status 1 <nil> <nil> true [0xc42027a730 0xc42027a778 0xc42027a7a8] [0xc42027a730 0xc42027a778 0xc42027a7a8] [0xc42027a760 0xc42027a790] [0xc37850 0xc37850] 0xc4210ca720 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421eb29b0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 11:02:25.861 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-107kw with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 11:02:25.871 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 11:02:26.063 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 11:02:26 GMT 2017]; root of context hierarchy\n2017-03-18 11:02:28.059 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 11:02:28.081 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 11:02:28.777 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 11:02:28.908 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.12]\n2017-03-18 11:02:28.908 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 11:02:28.919 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 11:02:28.960 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.12]:5701\n2017-03-18 11:02:28.960 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 11:02:28.960 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 11:02:29.329 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.12]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 11:02:30.347 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.2.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 11:02:30.670 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 11:02:30.677 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 11:02:30.716 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTING\n2017-03-18 11:02:30.721 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 11:02:30.777 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.12]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.12]:5701 - 928cd02b-1978-4888-a40d-64665b107cc5 this\n}\n\n2017-03-18 11:02:30.864 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTED\n2017-03-18 11:02:30.870 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 6.028 seconds (JVM running for 6.918)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 11:02:25.861 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-107kw with PID 5 (/bootstrapper.jar started by root in /)
2017-03-18 11:02:25.871 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 11:02:26.063 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 11:02:26 GMT 2017]; root of context hierarchy
2017-03-18 11:02:28.059 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 11:02:28.081 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 11:02:28.777 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 11:02:28.908 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.12]
2017-03-18 11:02:28.908 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 11:02:28.919 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 11:02:28.960 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.12]:5701
2017-03-18 11:02:28.960 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 11:02:28.960 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 11:02:29.329 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.12]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 11:02:30.347 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.2.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 11:02:30.670 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 11:02:30.677 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 11:02:30.716 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTING
2017-03-18 11:02:30.721 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 11:02:30.777 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.12]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.12]:5701 - 928cd02b-1978-4888-a40d-64665b107cc5 this
}
2017-03-18 11:02:30.864 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTED
2017-03-18 11:02:30.870 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 6.028 seconds (JVM running for 6.918)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4252/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421cb65b0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-vx4hf\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 12:22:14 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 12:22:15 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vx4hf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 12:22:15 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 12:22:15 Global memtable on-heap threshold is enabled at 128MB\nINFO 12:22:15 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 12:22:15 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.11
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.11
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.11
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-vx4hf
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 12:22:14 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 12:22:15 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vx4hf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 12:22:15 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 12:22:15 Global memtable on-heap threshold is enabled at 128MB
INFO 12:22:15 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 12:22:15 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xrgf0] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420a06f90 exit status 1 <nil> <nil> true [0xc420038e10 0xc420038e28 0xc420038e50] [0xc420038e10 0xc420038e28 0xc420038e50] [0xc420038e20 0xc420038e40] [0xc37850 0xc37850] 0xc420d80d20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xrgf0] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420a06f90 exit status 1 <nil> <nil> true [0xc420038e10 0xc420038e28 0xc420038e50] [0xc420038e10 0xc420038e28 0xc420038e50] [0xc420038e20 0xc420038e40] [0xc37850 0xc37850] 0xc420d80d20 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4215d9320>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 12:00:22.995 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-wqcms with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 12:00:23.022 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 12:00:23.101 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 12:00:23 GMT 2017]; root of context hierarchy\n2017-03-18 12:00:24.714 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 12:00:24.735 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 12:00:25.328 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 12:00:25.466 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.15]\n2017-03-18 12:00:25.467 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 12:00:25.479 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 12:00:25.522 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.15]:5701\n2017-03-18 12:00:25.522 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 12:00:25.522 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 12:00:25.887 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 12:00:26.764 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.2.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 12:00:27.037 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 12:00:27.040 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 12:00:27.049 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.15]:5701 [someGroup] [3.7.5] [10.180.2.15]:5701 is STARTING\n2017-03-18 12:00:27.062 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 12:00:27.132 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.15]:5701 - b5f02728-4503-4ca8-9aa3-2ff39cdb3516 this\n}\n\n2017-03-18 12:00:27.236 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.15]:5701 [someGroup] [3.7.5] [10.180.2.15]:5701 is STARTED\n2017-03-18 12:00:27.245 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.191 seconds (JVM running for 6.158)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 12:00:22.995 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-wqcms with PID 6 (/bootstrapper.jar started by root in /)
2017-03-18 12:00:23.022 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 12:00:23.101 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 12:00:23 GMT 2017]; root of context hierarchy
2017-03-18 12:00:24.714 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 12:00:24.735 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 12:00:25.328 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 12:00:25.466 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.15]
2017-03-18 12:00:25.467 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 12:00:25.479 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 12:00:25.522 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.15]:5701
2017-03-18 12:00:25.522 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 12:00:25.522 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 12:00:25.887 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 12:00:26.764 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.2.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 12:00:27.037 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 12:00:27.040 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 12:00:27.049 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.15]:5701 [someGroup] [3.7.5] [10.180.2.15]:5701 is STARTING
2017-03-18 12:00:27.062 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 12:00:27.132 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.15]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.15]:5701 - b5f02728-4503-4ca8-9aa3-2ff39cdb3516 this
}
2017-03-18 12:00:27.236 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.15]:5701 [someGroup] [3.7.5] [10.180.2.15]:5701 is STARTED
2017-03-18 12:00:27.245 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.191 seconds (JVM running for 6.158)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4253/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc4218806b0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.24\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.24\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.24\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.24\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-4h8x8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 13:28:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 13:28:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.24; broadcast_rpc_address=10.180.1.24; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.24; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4h8x8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 13:28:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 13:28:40 Global memtable on-heap threshold is enabled at 128MB\nINFO 13:28:40 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:28:40 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.24
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.24
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.24
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.24
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-4h8x8
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 13:28:40 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 13:28:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.24; broadcast_rpc_address=10.180.1.24; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.24; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4h8x8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 13:28:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 13:28:40 Global memtable on-heap threshold is enabled at 128MB
INFO 13:28:40 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 13:28:40 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420871500>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 13:08:36.701 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-1t6b8 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 13:08:36.729 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 13:08:36.859 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 13:08:36 GMT 2017]; root of context hierarchy\n2017-03-18 13:08:38.576 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 13:08:38.595 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 13:08:39.288 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 13:08:39.441 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.17]\n2017-03-18 13:08:39.441 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 13:08:39.454 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 13:08:39.491 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.17]:5701\n2017-03-18 13:08:39.491 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 13:08:39.491 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 13:08:39.850 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 13:08:40.755 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 13:08:41.078 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 13:08:41.085 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 13:08:41.118 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTING\n2017-03-18 13:08:41.122 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 13:08:41.150 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.17]:5701 - 0e82d064-88c9-4713-8d2b-f1f73cb14b10 this\n}\n\n2017-03-18 13:08:41.245 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTED\n2017-03-18 13:08:41.253 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.559 seconds (JVM running for 6.541)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 13:08:36.701 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-1t6b8 with PID 6 (/bootstrapper.jar started by root in /)
2017-03-18 13:08:36.729 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 13:08:36.859 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 13:08:36 GMT 2017]; root of context hierarchy
2017-03-18 13:08:38.576 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 13:08:38.595 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 13:08:39.288 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 13:08:39.441 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.17]
2017-03-18 13:08:39.441 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 13:08:39.454 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 13:08:39.491 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.17]:5701
2017-03-18 13:08:39.491 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 13:08:39.491 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 13:08:39.850 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 13:08:40.755 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 13:08:41.078 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 13:08:41.085 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 13:08:41.118 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTING
2017-03-18 13:08:41.122 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 13:08:41.150 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.17]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.17]:5701 - 0e82d064-88c9-4713-8d2b-f1f73cb14b10 this
}
2017-03-18 13:08:41.245 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTED
2017-03-18 13:08:41.253 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.559 seconds (JVM running for 6.541)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-sfb8x] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4217a5590 exit status 1 <nil> <nil> true [0xc4202b42f0 0xc4202b4328 0xc4202b4380] [0xc4202b42f0 0xc4202b4328 0xc4202b4380] [0xc4202b4320 0xc4202b4368] [0xc37850 0xc37850] 0xc4210b2480 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-sfb8x] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4217a5590 exit status 1 <nil> <nil> true [0xc4202b42f0 0xc4202b4328 0xc4202b4380] [0xc4202b42f0 0xc4202b4328 0xc4202b4380] [0xc4202b4320 0xc4202b4368] [0xc37850 0xc37850] 0xc4210b2480 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4254/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tqc2k] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420805590 exit status 1 <nil> <nil> true [0xc42032c3d0 0xc42032c3e8 0xc42032c400] [0xc42032c3d0 0xc42032c3e8 0xc42032c400] [0xc42032c3e0 0xc42032c3f8] [0xc37850 0xc37850] 0xc4213a6b40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tqc2k] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420805590 exit status 1 <nil> <nil> true [0xc42032c3d0 0xc42032c3e8 0xc42032c400] [0xc42032c3d0 0xc42032c3e8 0xc42032c400] [0xc42032c3e0 0xc42032c3f8] [0xc37850 0xc37850] 0xc4213a6b40 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420dcebb0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.23\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.23\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.23\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.23\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-73c76\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 14:34:35 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 14:34:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.23; broadcast_rpc_address=10.180.1.23; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.23; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-73c76}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 14:34:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 14:34:36 Global memtable on-heap threshold is enabled at 128MB\nINFO 14:34:36 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:34:36 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.23
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.23
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.23
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.23
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-73c76
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 14:34:35 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 14:34:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.23; broadcast_rpc_address=10.180.1.23; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.23; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-73c76}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 14:34:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 14:34:36 Global memtable on-heap threshold is enabled at 128MB
INFO 14:34:36 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 14:34:36 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420e360c0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 14:11:15.508 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-xn8v6 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 14:11:15.515 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 14:11:15.629 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 14:11:15 GMT 2017]; root of context hierarchy\n2017-03-18 14:11:17.122 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 14:11:17.147 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 14:11:17.773 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 14:11:17.890 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-18 14:11:17.891 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 14:11:17.903 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 14:11:17.938 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-18 14:11:17.938 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 14:11:17.938 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 14:11:18.318 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 14:11:19.234 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 14:11:19.614 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 14:11:19.622 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 14:11:19.632 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-18 14:11:19.634 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 14:11:19.690 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - c0b14448-a294-4c36-a9db-9bf4d0022eaa this\n}\n\n2017-03-18 14:11:19.769 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-18 14:11:19.774 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.263 seconds (JVM running for 6.223)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 14:11:15.508 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-xn8v6 with PID 5 (/bootstrapper.jar started by root in /)
2017-03-18 14:11:15.515 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 14:11:15.629 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 14:11:15 GMT 2017]; root of context hierarchy
2017-03-18 14:11:17.122 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 14:11:17.147 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 14:11:17.773 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 14:11:17.890 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
2017-03-18 14:11:17.891 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 14:11:17.903 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 14:11:17.938 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
2017-03-18 14:11:17.938 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 14:11:17.938 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 14:11:18.318 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 14:11:19.234 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 14:11:19.614 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 14:11:19.622 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 14:11:19.632 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
2017-03-18 14:11:19.634 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 14:11:19.690 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.16]:5701 - c0b14448-a294-4c36-a9db-9bf4d0022eaa this
}
2017-03-18 14:11:19.769 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
2017-03-18 14:11:19.774 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.263 seconds (JVM running for 6.223)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4255/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc42129ca20>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-szrmn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 15:19:41 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 15:19:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-szrmn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 15:19:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 15:19:41 Global memtable on-heap threshold is enabled at 128MB\nINFO 15:19:41 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:19:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.7
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.7
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.7
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-szrmn
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 15:19:41 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 15:19:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-szrmn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 15:19:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 15:19:41 Global memtable on-heap threshold is enabled at 128MB
INFO 15:19:41 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 15:19:41 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4207e4500>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 15:27:27.100 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-2jvtn with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 15:27:27.108 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 15:27:27.245 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 15:27:27 GMT 2017]; root of context hierarchy\n2017-03-18 15:27:29.013 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 15:27:29.034 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 15:27:29.710 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 15:27:29.859 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.11]\n2017-03-18 15:27:29.859 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 15:27:29.870 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 15:27:29.906 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.11]:5701\n2017-03-18 15:27:29.907 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 15:27:29.907 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 15:27:30.285 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.11]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 15:27:31.171 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 15:27:31.463 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 15:27:31.473 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 15:27:31.499 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTING\n2017-03-18 15:27:31.503 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 15:27:31.533 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.11]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.11]:5701 - ddd84679-9f14-451a-829a-7c4f678a8cbc this\n}\n\n2017-03-18 15:27:31.615 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTED\n2017-03-18 15:27:31.621 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.522 seconds (JVM running for 6.37)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 15:27:27.100 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-2jvtn with PID 6 (/bootstrapper.jar started by root in /)
2017-03-18 15:27:27.108 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 15:27:27.245 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 15:27:27 GMT 2017]; root of context hierarchy
2017-03-18 15:27:29.013 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 15:27:29.034 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 15:27:29.710 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 15:27:29.859 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.11]
2017-03-18 15:27:29.859 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 15:27:29.870 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 15:27:29.906 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.11]:5701
2017-03-18 15:27:29.907 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 15:27:29.907 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 15:27:30.285 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.11]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 15:27:31.171 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 15:27:31.463 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 15:27:31.473 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 15:27:31.499 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTING
2017-03-18 15:27:31.503 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 15:27:31.533 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.11]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.11]:5701 - ddd84679-9f14-451a-829a-7c4f678a8cbc this
}
2017-03-18 15:27:31.615 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTED
2017-03-18 15:27:31.621 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.522 seconds (JVM running for 6.37)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-k2lt8] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ec5440 exit status 1 <nil> <nil> true [0xc420038c50 0xc420038c68 0xc420038c88] [0xc420038c50 0xc420038c68 0xc420038c88] [0xc420038c60 0xc420038c78] [0xc37850 0xc37850] 0xc421ff3800 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-k2lt8] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420ec5440 exit status 1 <nil> <nil> true [0xc420038c50 0xc420038c68 0xc420038c88] [0xc420038c50 0xc420038c68 0xc420038c88] [0xc420038c60 0xc420038c78] [0xc37850 0xc37850] 0xc421ff3800 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4257/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc4207de610>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-17cxm\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 17:40:52 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 17:40:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-17cxm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 17:40:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 17:40:53 Global memtable on-heap threshold is enabled at 128MB\nINFO 17:40:53 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:40:53 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.10
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-17cxm
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 17:40:52 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 17:40:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-17cxm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 17:40:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 17:40:53 Global memtable on-heap threshold is enabled at 128MB
INFO 17:40:53 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 17:40:53 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4208a8430>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 17:46:20.559 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-dzn4h with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 17:46:20.567 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 17:46:20.726 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 17:46:20 GMT 2017]; root of context hierarchy\n2017-03-18 17:46:22.701 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 17:46:22.730 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 17:46:23.461 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 17:46:23.582 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.21]\n2017-03-18 17:46:23.583 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 17:46:23.596 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 17:46:23.632 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.21]:5701\n2017-03-18 17:46:23.633 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 17:46:23.633 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 17:46:23.973 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.21]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 17:46:24.881 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 17:46:25.183 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 17:46:25.191 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 17:46:25.200 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTING\n2017-03-18 17:46:25.203 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 17:46:25.231 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.21]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.21]:5701 - a744a6bb-420c-40f2-89b3-fd0de4a493ee this\n}\n\n2017-03-18 17:46:25.306 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTED\n2017-03-18 17:46:25.310 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.769 seconds (JVM running for 6.726)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 17:46:20.559 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-dzn4h with PID 5 (/bootstrapper.jar started by root in /)
2017-03-18 17:46:20.567 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 17:46:20.726 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 17:46:20 GMT 2017]; root of context hierarchy
2017-03-18 17:46:22.701 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 17:46:22.730 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 17:46:23.461 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 17:46:23.582 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.21]
2017-03-18 17:46:23.583 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 17:46:23.596 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 17:46:23.632 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.21]:5701
2017-03-18 17:46:23.633 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 17:46:23.633 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 17:46:23.973 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.21]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 17:46:24.881 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 17:46:25.183 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 17:46:25.191 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 17:46:25.200 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTING
2017-03-18 17:46:25.203 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 17:46:25.231 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.21]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.21]:5701 - a744a6bb-420c-40f2-89b3-fd0de4a493ee this
}
2017-03-18 17:46:25.306 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTED
2017-03-18 17:46:25.310 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.769 seconds (JVM running for 6.726)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jkc5z] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4212fe4b0 exit status 1 <nil> <nil> true [0xc4202fab70 0xc4202fab98 0xc4202fabc8] [0xc4202fab70 0xc4202fab98 0xc4202fabc8] [0xc4202fab80 0xc4202fabc0] [0xc37850 0xc37850] 0xc420bd4600 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jkc5z] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4212fe4b0 exit status 1 <nil> <nil> true [0xc4202fab70 0xc4202fab98 0xc4202fabc8] [0xc4202fab70 0xc4202fab98 0xc4202fabc8] [0xc4202fab80 0xc4202fabc0] [0xc37850 0xc37850] 0xc420bd4600 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4258/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.53.178 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5zrj6] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420cefbf0 exit status 1 <nil> <nil> true [0xc420ec46e8 0xc420ec4710 0xc420ec4740] [0xc420ec46e8 0xc420ec4710 0xc420ec4740] [0xc420ec46f8 0xc420ec4730] [0xc37850 0xc37850] 0xc420a50c00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.53.178 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5zrj6] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420cefbf0 exit status 1 <nil> <nil> true [0xc420ec46e8 0xc420ec4710 0xc420ec4740] [0xc420ec46e8 0xc420ec4710 0xc420ec4740] [0xc420ec46f8 0xc420ec4730] [0xc37850 0xc37850] 0xc420a50c00 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421c58a70>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.16\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.16\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.16\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-hbsd4\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 18:48:30 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 18:48:31 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hbsd4}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 18:48:31 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 18:48:31 Global memtable on-heap threshold is enabled at 128MB\nINFO 18:48:31 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:48:31 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.16
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.16
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.16
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-hbsd4
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 18:48:30 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 18:48:31 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hbsd4}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 18:48:31 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 18:48:31 Global memtable on-heap threshold is enabled at 128MB
INFO 18:48:31 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 18:48:31 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421cda230>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 18:51:23.005 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-0g8pz with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 18:51:23.015 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 18:51:23.146 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 18:51:23 GMT 2017]; root of context hierarchy\n2017-03-18 18:51:24.667 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 18:51:24.687 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 18:51:25.296 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 18:51:25.465 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-18 18:51:25.465 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 18:51:25.476 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 18:51:25.508 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-18 18:51:25.508 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 18:51:25.509 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 18:51:25.841 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 18:51:26.706 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 18:51:27.092 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 18:51:27.096 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 18:51:27.105 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-18 18:51:27.110 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 18:51:27.179 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - ad0a47ce-7f8c-4af7-be72-861f3cfefe6a this\n}\n\n2017-03-18 18:51:27.259 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-18 18:51:27.265 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.246 seconds (JVM running for 6.156)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 18:51:23.005 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-0g8pz with PID 5 (/bootstrapper.jar started by root in /)
2017-03-18 18:51:23.015 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 18:51:23.146 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 18:51:23 GMT 2017]; root of context hierarchy
2017-03-18 18:51:24.667 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 18:51:24.687 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 18:51:25.296 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 18:51:25.465 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
2017-03-18 18:51:25.465 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 18:51:25.476 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 18:51:25.508 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
2017-03-18 18:51:25.508 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 18:51:25.509 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 18:51:25.841 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 18:51:26.706 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 18:51:27.092 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 18:51:27.096 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 18:51:27.105 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
2017-03-18 18:51:27.110 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 18:51:27.179 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.16]:5701 - ad0a47ce-7f8c-4af7-be72-861f3cfefe6a this
}
2017-03-18 18:51:27.259 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
2017-03-18 18:51:27.265 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.246 seconds (JVM running for 6.156)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4259/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc42115a3f0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 19:36:23.596 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-wb6kb with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-18 19:36:23.612 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 19:36:23.723 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 19:36:23 GMT 2017]; root of context hierarchy\n2017-03-18 19:36:25.417 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 19:36:25.436 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 19:36:26.050 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 19:36:26.191 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.8]\n2017-03-18 19:36:26.192 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 19:36:26.203 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 19:36:26.236 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701\n2017-03-18 19:36:26.237 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 19:36:26.237 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 19:36:26.595 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 19:36:27.433 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 19:36:27.720 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 19:36:27.729 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 19:36:27.741 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING\n2017-03-18 19:36:27.747 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 19:36:27.782 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.8]:5701 - ba3a6d3c-a5cb-4fb1-8901-5d953e5b38b0 this\n}\n\n2017-03-18 19:36:27.840 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED\n2017-03-18 19:36:27.855 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.238 seconds (JVM running for 6.078)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 19:36:23.596 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-wb6kb with PID 7 (/bootstrapper.jar started by root in /)
2017-03-18 19:36:23.612 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 19:36:23.723 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 19:36:23 GMT 2017]; root of context hierarchy
2017-03-18 19:36:25.417 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 19:36:25.436 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 19:36:26.050 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 19:36:26.191 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.8]
2017-03-18 19:36:26.192 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 19:36:26.203 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 19:36:26.236 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701
2017-03-18 19:36:26.237 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 19:36:26.237 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 19:36:26.595 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 19:36:27.433 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 19:36:27.720 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 19:36:27.729 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 19:36:27.741 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING
2017-03-18 19:36:27.747 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 19:36:27.782 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.8]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.8]:5701 - ba3a6d3c-a5cb-4fb1-8901-5d953e5b38b0 this
}
2017-03-18 19:36:27.840 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED
2017-03-18 19:36:27.855 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.238 seconds (JVM running for 6.078)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xz1kj] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421072480 exit status 1 <nil> <nil> true [0xc4200389a0 0xc420038a08 0xc420038a38] [0xc4200389a0 0xc420038a08 0xc420038a38] [0xc4200389f8 0xc420038a28] [0xc37850 0xc37850] 0xc420b5aa20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xz1kj] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc421072480 exit status 1 <nil> <nil> true [0xc4200389a0 0xc420038a08 0xc420038a38] [0xc4200389a0 0xc420038a08 0xc420038a38] [0xc4200389f8 0xc420038a28] [0xc37850 0xc37850] 0xc420b5aa20 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc42157d3e0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.22\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.22\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.22\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.22\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-5gt04\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 20:06:55 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 20:06:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.22; broadcast_rpc_address=10.180.1.22; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.22; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5gt04}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 20:06:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 20:06:56 Global memtable on-heap threshold is enabled at 128MB\nINFO 20:06:56 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 20:06:56 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.22
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.22
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.22
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.22
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-5gt04
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 20:06:55 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 20:06:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.22; broadcast_rpc_address=10.180.1.22; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.22; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5gt04}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 20:06:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 20:06:56 Global memtable on-heap threshold is enabled at 128MB
INFO 20:06:56 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 20:06:56 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4260/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421ebedd0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-q2m7n\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 21:11:23 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 21:11:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q2m7n}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 21:11:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 21:11:23 Global memtable on-heap threshold is enabled at 128MB\nINFO 21:11:23 Global memtable off-heap threshold is enabled at 128MB\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\nERROR 21:11:23 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.15
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.15
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.15
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-q2m7n
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 21:11:23 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 21:11:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q2m7n}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 21:11:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 21:11:23 Global memtable on-heap threshold is enabled at 128MB
INFO 21:11:23 Global memtable off-heap threshold is enabled at 128MB
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
ERROR 21:11:23 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420d26080>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 20:51:10.246 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-7kvlg with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 20:51:10.259 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 20:51:10.326 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 20:51:10 GMT 2017]; root of context hierarchy\n2017-03-18 20:51:12.123 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 20:51:12.143 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 20:51:12.775 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 20:51:12.886 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.9]\n2017-03-18 20:51:12.886 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 20:51:12.899 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 20:51:12.932 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.9]:5701\n2017-03-18 20:51:12.932 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 20:51:12.932 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 20:51:13.403 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 20:51:14.251 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 20:51:14.537 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 20:51:14.549 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 20:51:14.557 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTING\n2017-03-18 20:51:14.561 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 20:51:14.580 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.9]:5701 - b73a0fe7-d309-4605-99f1-a377537fea03 this\n}\n\n2017-03-18 20:51:14.644 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTED\n2017-03-18 20:51:14.655 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.479 seconds (JVM running for 6.322)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 20:51:10.246 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-7kvlg with PID 5 (/bootstrapper.jar started by root in /)
2017-03-18 20:51:10.259 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 20:51:10.326 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 20:51:10 GMT 2017]; root of context hierarchy
2017-03-18 20:51:12.123 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 20:51:12.143 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 20:51:12.775 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 20:51:12.886 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.9]
2017-03-18 20:51:12.886 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 20:51:12.899 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 20:51:12.932 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.9]:5701
2017-03-18 20:51:12.932 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 20:51:12.932 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 20:51:13.403 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 20:51:14.251 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 20:51:14.537 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 20:51:14.549 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 20:51:14.557 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTING
2017-03-18 20:51:14.561 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 20:51:14.580 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.9]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.9]:5701 - b73a0fe7-d309-4605-99f1-a377537fea03 this
}
2017-03-18 20:51:14.644 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTED
2017-03-18 20:51:14.655 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.479 seconds (JVM running for 6.322)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-d9kff] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42075ac00 exit status 1 <nil> <nil> true [0xc4205885e0 0xc4205885f8 0xc420588618] [0xc4205885e0 0xc4205885f8 0xc420588618] [0xc4205885f0 0xc420588608] [0xc37850 0xc37850] 0xc420f02f00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-d9kff] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42075ac00 exit status 1 <nil> <nil> true [0xc4205885e0 0xc4205885f8 0xc420588618] [0xc4205885e0 0xc4205885f8 0xc420588618] [0xc4205885f0 0xc420588608] [0xc37850 0xc37850] 0xc420f02f00 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4261/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc42179a800>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-18 21:57:27.520 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-csxj2 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 21:57:27.528 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-18 21:57:27.678 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 21:57:27 GMT 2017]; root of context hierarchy\n2017-03-18 21:57:29.347 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-18 21:57:29.376 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 21:57:30.022 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-18 21:57:30.176 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.5]\n2017-03-18 21:57:30.177 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 21:57:30.189 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 21:57:30.226 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.5]:5701\n2017-03-18 21:57:30.226 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 21:57:30.226 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 21:57:30.618 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.5]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 21:57:31.622 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.5]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 21:57:31.915 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 21:57:31.918 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 21:57:31.927 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTING\n2017-03-18 21:57:31.932 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.5]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 21:57:31.958 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.5]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.5]:5701 - e7f18455-4361-4085-8ed0-59b000910c7e this\n}\n\n2017-03-18 21:57:32.020 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTED\n2017-03-18 21:57:32.031 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.52 seconds (JVM running for 6.442)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-18 21:57:27.520 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-csxj2 with PID 5 (/bootstrapper.jar started by root in /)
2017-03-18 21:57:27.528 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-18 21:57:27.678 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 21:57:27 GMT 2017]; root of context hierarchy
2017-03-18 21:57:29.347 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-18 21:57:29.376 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-18 21:57:30.022 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-18 21:57:30.176 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.5]
2017-03-18 21:57:30.177 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-18 21:57:30.189 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-18 21:57:30.226 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.5]:5701
2017-03-18 21:57:30.226 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-18 21:57:30.226 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-18 21:57:30.618 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.5]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-18 21:57:31.622 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.5]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-18 21:57:31.915 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-18 21:57:31.918 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-18 21:57:31.927 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTING
2017-03-18 21:57:31.932 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.5]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-18 21:57:31.958 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.5]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.5]:5701 - e7f18455-4361-4085-8ed0-59b000910c7e this
}
2017-03-18 21:57:32.020 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTED
2017-03-18 21:57:32.031 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.52 seconds (JVM running for 6.442)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-c18gx] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c1b800 exit status 1 <nil> <nil> true [0xc420b144e0 0xc420b14508 0xc420b14528] [0xc420b144e0 0xc420b14508 0xc420b14528] [0xc420b144f8 0xc420b14520] [0xc37850 0xc37850] 0xc420dfaa20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-c18gx] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420c1b800 exit status 1 <nil> <nil> true [0xc420b144e0 0xc420b14508 0xc420b14528] [0xc420b144e0 0xc420b14508 0xc420b14528] [0xc420b144f8 0xc420b14520] [0xc37850 0xc37850] 0xc420dfaa20 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421358080>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.4\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.4\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.4\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.4\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0plsw\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 21:54:47 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 21:54:47 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.4; broadcast_rpc_address=10.180.3.4; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.4; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0plsw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 21:54:47 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 21:54:47 Global memtable on-heap threshold is enabled at 128MB\nINFO 21:54:47 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 21:54:47 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.4
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.4
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.4
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.4
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-0plsw
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 21:54:47 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 21:54:47 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.4; broadcast_rpc_address=10.180.3.4; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.4; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0plsw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 21:54:47 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 21:54:47 Global memtable on-heap threshold is enabled at 128MB
INFO 21:54:47 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 21:54:47 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4263/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc4208ac040>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2p8kd\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 00:09:56 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 00:09:57 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2p8kd}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 00:09:57 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 00:09:57 Global memtable on-heap threshold is enabled at 128MB\nINFO 00:09:57 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 00:09:57 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.15
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.15
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.15
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-2p8kd
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 00:09:56 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 00:09:57 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2p8kd}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 00:09:57 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 00:09:57 Global memtable on-heap threshold is enabled at 128MB
INFO 00:09:57 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 00:09:57 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4214e6f30>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 00:20:22.260 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-b7dft with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 00:20:22.268 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 00:20:22.401 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 00:20:22 GMT 2017]; root of context hierarchy\n2017-03-19 00:20:24.194 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 00:20:24.215 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 00:20:24.933 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 00:20:25.046 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.24]\n2017-03-19 00:20:25.047 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 00:20:25.061 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.24]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 00:20:25.095 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.24]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.24]:5701\n2017-03-19 00:20:25.095 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.24]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 00:20:25.095 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.24]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 00:20:25.449 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.24]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 00:20:26.346 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.2.24]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 00:20:26.631 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.24]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 00:20:26.646 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.24]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 00:20:26.667 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.24]:5701 [someGroup] [3.7.5] [10.180.2.24]:5701 is STARTING\n2017-03-19 00:20:26.670 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.24]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 00:20:26.720 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.24]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.24]:5701 - 2d53fdd2-91b0-4df8-b1ca-7c15e6e3c44e this\n}\n\n2017-03-19 00:20:26.805 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.24]:5701 [someGroup] [3.7.5] [10.180.2.24]:5701 is STARTED\n2017-03-19 00:20:26.813 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.464 seconds (JVM running for 6.341)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 00:20:22.260 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-b7dft with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 00:20:22.268 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 00:20:22.401 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 00:20:22 GMT 2017]; root of context hierarchy
2017-03-19 00:20:24.194 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 00:20:24.215 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 00:20:24.933 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 00:20:25.046 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.24]
2017-03-19 00:20:25.047 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 00:20:25.061 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.24]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 00:20:25.095 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.24]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.24]:5701
2017-03-19 00:20:25.095 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.24]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 00:20:25.095 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.24]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 00:20:25.449 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.24]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 00:20:26.346 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.2.24]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 00:20:26.631 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.24]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 00:20:26.646 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.24]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 00:20:26.667 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.24]:5701 [someGroup] [3.7.5] [10.180.2.24]:5701 is STARTING
2017-03-19 00:20:26.670 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.24]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 00:20:26.720 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.24]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.24]:5701 - 2d53fdd2-91b0-4df8-b1ca-7c15e6e3c44e this
}
2017-03-19 00:20:26.805 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.24]:5701 [someGroup] [3.7.5] [10.180.2.24]:5701 is STARTED
2017-03-19 00:20:26.813 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.464 seconds (JVM running for 6.341)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-48bn8] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421017dd0 exit status 1 <nil> <nil> true [0xc42065e3b0 0xc42065e3c8 0xc42065e3e0] [0xc42065e3b0 0xc42065e3c8 0xc42065e3e0] [0xc42065e3c0 0xc42065e3d8] [0xc37850 0xc37850] 0xc4214552c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-48bn8] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc421017dd0 exit status 1 <nil> <nil> true [0xc42065e3b0 0xc42065e3c8 0xc42065e3e0] [0xc42065e3b0 0xc42065e3c8 0xc42065e3e0] [0xc42065e3c0 0xc42065e3d8] [0xc37850 0xc37850] 0xc4214552c0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4264/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc4214680f0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-fbpkm\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 01:24:20 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 01:24:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fbpkm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 01:24:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 01:24:20 Global memtable on-heap threshold is enabled at 128MB\nINFO 01:24:20 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:24:20 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.14
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-fbpkm
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 01:24:20 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 01:24:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fbpkm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 01:24:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 01:24:20 Global memtable on-heap threshold is enabled at 128MB
INFO 01:24:20 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 01:24:20 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.189.130 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-crpqh] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42138a7b0 exit status 1 <nil> <nil> true [0xc4202b51d8 0xc4202b51f0 0xc4202b5210] [0xc4202b51d8 0xc4202b51f0 0xc4202b5210] [0xc4202b51e8 0xc4202b5208] [0xc37850 0xc37850] 0xc4209ee7e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.189.130 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-crpqh] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42138a7b0 exit status 1 <nil> <nil> true [0xc4202b51d8 0xc4202b51f0 0xc4202b5210] [0xc4202b51d8 0xc4202b51f0 0xc4202b5210] [0xc4202b51e8 0xc4202b5208] [0xc37850 0xc37850] 0xc4209ee7e0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420edefa0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 01:08:57.213 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-43xvq with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 01:08:57.220 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 01:08:57.325 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 01:08:57 GMT 2017]; root of context hierarchy\n2017-03-19 01:08:59.035 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 01:08:59.054 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 01:08:59.686 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 01:08:59.803 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.13]\n2017-03-19 01:08:59.803 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 01:08:59.816 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 01:08:59.848 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.13]:5701\n2017-03-19 01:08:59.849 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 01:08:59.849 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 01:09:00.207 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 01:09:01.239 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 01:09:01.609 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 01:09:01.612 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 01:09:01.641 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTING\n2017-03-19 01:09:01.646 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 01:09:01.681 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.13]:5701 - 5f29cf48-08c4-48e0-ad65-ef6ef5c33ba0 this\n}\n\n2017-03-19 01:09:01.765 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTED\n2017-03-19 01:09:01.774 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.614 seconds (JVM running for 6.48)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 01:08:57.213 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-43xvq with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 01:08:57.220 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 01:08:57.325 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 01:08:57 GMT 2017]; root of context hierarchy
2017-03-19 01:08:59.035 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 01:08:59.054 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 01:08:59.686 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 01:08:59.803 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.13]
2017-03-19 01:08:59.803 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 01:08:59.816 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 01:08:59.848 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.13]:5701
2017-03-19 01:08:59.849 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 01:08:59.849 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 01:09:00.207 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 01:09:01.239 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 01:09:01.609 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 01:09:01.612 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 01:09:01.641 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTING
2017-03-19 01:09:01.646 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 01:09:01.681 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.13]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.13]:5701 - 5f29cf48-08c4-48e0-ad65-ef6ef5c33ba0 this
}
2017-03-19 01:09:01.765 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTED
2017-03-19 01:09:01.774 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.614 seconds (JVM running for 6.48)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4265/ Multiple broken tests:
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-mxl3h] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420a58ea0 exit status 1 <nil> <nil> true [0xc420470890 0xc4204708b8 0xc420470928] [0xc420470890 0xc4204708b8 0xc420470928] [0xc4204708a0 0xc4204708f8] [0xc37850 0xc37850] 0xc4211fd7a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-mxl3h] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420a58ea0 exit status 1 <nil> <nil> true [0xc420470890 0xc4204708b8 0xc420470928] [0xc420470890 0xc4204708b8 0xc420470928] [0xc4204708a0 0xc4204708f8] [0xc37850 0xc37850] 0xc4211fd7a0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc42089cbd0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-bm4gj\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 02:13:26 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 02:13:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bm4gj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 02:13:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 02:13:26 Global memtable on-heap threshold is enabled at 128MB\nINFO 02:13:26 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 02:13:26 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.7
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.7
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.7
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-bm4gj
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 02:13:26 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 02:13:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bm4gj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 02:13:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 02:13:26 Global memtable on-heap threshold is enabled at 128MB
INFO 02:13:26 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 02:13:26 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421118590>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 02:16:12.711 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-0z3bx with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 02:16:12.721 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 02:16:12.817 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 02:16:12 GMT 2017]; root of context hierarchy\n2017-03-19 02:16:15.379 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 02:16:15.429 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 02:16:16.535 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 02:16:16.784 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-19 02:16:16.785 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 02:16:16.817 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 02:16:16.874 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-19 02:16:16.875 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 02:16:16.875 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 02:16:17.413 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 02:16:18.568 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 02:16:18.927 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 02:16:18.949 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 02:16:18.989 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-19 02:16:18.994 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 02:16:19.050 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - 3f6364e6-a7eb-4ac3-a4ec-3467927c803f this\n}\n\n2017-03-19 02:16:19.155 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-19 02:16:19.159 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 7.891 seconds (JVM running for 9.217)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 02:16:12.711 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-0z3bx with PID 5 (/bootstrapper.jar started by root in /)
2017-03-19 02:16:12.721 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 02:16:12.817 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 02:16:12 GMT 2017]; root of context hierarchy
2017-03-19 02:16:15.379 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 02:16:15.429 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 02:16:16.535 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 02:16:16.784 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
2017-03-19 02:16:16.785 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 02:16:16.817 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 02:16:16.874 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
2017-03-19 02:16:16.875 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 02:16:16.875 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 02:16:17.413 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 02:16:18.568 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 02:16:18.927 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 02:16:18.949 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 02:16:18.989 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
2017-03-19 02:16:18.994 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 02:16:19.050 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.14]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.14]:5701 - 3f6364e6-a7eb-4ac3-a4ec-3467927c803f this
}
2017-03-19 02:16:19.155 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
2017-03-19 02:16:19.159 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 7.891 seconds (JVM running for 9.217)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4266/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-w8dm0] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ea6ae0 exit status 1 <nil> <nil> true [0xc420280408 0xc420280420 0xc420280438] [0xc420280408 0xc420280420 0xc420280438] [0xc420280418 0xc420280430] [0xc37850 0xc37850] 0xc42127ab40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-w8dm0] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420ea6ae0 exit status 1 <nil> <nil> true [0xc420280408 0xc420280420 0xc420280438] [0xc420280408 0xc420280420 0xc420280438] [0xc420280418 0xc420280430] [0xc37850 0xc37850] 0xc42127ab40 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421d58050>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 03:15:55.883 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-c3hpr with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 03:15:55.891 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 03:15:55.978 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 03:15:55 GMT 2017]; root of context hierarchy\n2017-03-19 03:15:57.748 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 03:15:57.770 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 03:15:58.415 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 03:15:58.537 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]\n2017-03-19 03:15:58.537 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 03:15:58.550 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 03:15:58.585 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-19 03:15:58.586 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 03:15:58.586 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 03:15:58.958 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 03:15:59.779 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 03:16:00.044 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 03:16:00.047 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 03:16:00.079 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-19 03:16:00.083 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 03:16:00.131 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 39cd86cf-a127-447e-b192-9c528d7c12be this\n}\n\n2017-03-19 03:16:00.215 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-19 03:16:00.219 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.324 seconds (JVM running for 6.224)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 03:15:55.883 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-c3hpr with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 03:15:55.891 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 03:15:55.978 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 03:15:55 GMT 2017]; root of context hierarchy
2017-03-19 03:15:57.748 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 03:15:57.770 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 03:15:58.415 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 03:15:58.537 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]
2017-03-19 03:15:58.537 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 03:15:58.550 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 03:15:58.585 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
2017-03-19 03:15:58.586 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 03:15:58.586 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 03:15:58.958 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 03:15:59.779 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 03:16:00.044 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 03:16:00.047 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 03:16:00.079 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
2017-03-19 03:16:00.083 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 03:16:00.131 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.6]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.6]:5701 - 39cd86cf-a127-447e-b192-9c528d7c12be this
}
2017-03-19 03:16:00.215 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
2017-03-19 03:16:00.219 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.324 seconds (JVM running for 6.224)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421698310>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-6mnf2\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 03:13:23 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 03:13:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6mnf2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 03:13:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 03:13:24 Global memtable on-heap threshold is enabled at 128MB\nINFO 03:13:24 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 03:13:24 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.9
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.9
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.9
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-6mnf2
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 03:13:23 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 03:13:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6mnf2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 03:13:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 03:13:24 Global memtable on-heap threshold is enabled at 128MB
INFO 03:13:24 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 03:13:24 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4267/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420f91090>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 04:14:27.588 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-hp9cj with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 04:14:27.597 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 04:14:27.754 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 04:14:27 GMT 2017]; root of context hierarchy\n2017-03-19 04:14:29.494 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 04:14:29.517 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 04:14:30.202 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 04:14:30.345 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.7]\n2017-03-19 04:14:30.346 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 04:14:30.359 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 04:14:30.392 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.7]:5701\n2017-03-19 04:14:30.393 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 04:14:30.393 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 04:14:30.748 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.7]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 04:14:31.639 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 04:14:31.975 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 04:14:31.990 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 04:14:32.003 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTING\n2017-03-19 04:14:32.005 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 04:14:32.056 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.7]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.7]:5701 - 9a56fa83-4a52-4074-a5be-dc49a08c0aee this\n}\n\n2017-03-19 04:14:32.145 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTED\n2017-03-19 04:14:32.151 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.639 seconds (JVM running for 6.506)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 04:14:27.588 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-hp9cj with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 04:14:27.597 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 04:14:27.754 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 04:14:27 GMT 2017]; root of context hierarchy
2017-03-19 04:14:29.494 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 04:14:29.517 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 04:14:30.202 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 04:14:30.345 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.7]
2017-03-19 04:14:30.346 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 04:14:30.359 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 04:14:30.392 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.7]:5701
2017-03-19 04:14:30.393 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 04:14:30.393 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 04:14:30.748 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.7]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 04:14:31.639 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 04:14:31.975 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 04:14:31.990 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 04:14:32.003 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTING
2017-03-19 04:14:32.005 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 04:14:32.056 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.7]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.7]:5701 - 9a56fa83-4a52-4074-a5be-dc49a08c0aee this
}
2017-03-19 04:14:32.145 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTED
2017-03-19 04:14:32.151 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.639 seconds (JVM running for 6.506)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-hp0bj] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42137a6f0 exit status 1 <nil> <nil> true [0xc420038168 0xc420038198 0xc4200381b8] [0xc420038168 0xc420038198 0xc4200381b8] [0xc420038180 0xc4200381b0] [0xc37850 0xc37850] 0xc421902a20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-hp0bj] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42137a6f0 exit status 1 <nil> <nil> true [0xc420038168 0xc420038198 0xc4200381b8] [0xc420038168 0xc420038198 0xc4200381b8] [0xc420038180 0xc4200381b0] [0xc37850 0xc37850] 0xc421902a20 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421538e80>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-j2kqz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 04:36:33 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 04:36:34 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.12; broadcast_rpc_address=10.180.1.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j2kqz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 04:36:34 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 04:36:34 Global memtable on-heap threshold is enabled at 128MB\nINFO 04:36:34 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 04:36:34 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.12
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.12
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.12
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.12
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-j2kqz
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 04:36:33 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 04:36:34 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.12; broadcast_rpc_address=10.180.1.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j2kqz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 04:36:34 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 04:36:34 Global memtable on-heap threshold is enabled at 128MB
INFO 04:36:34 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 04:36:34 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4268/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1kvd4] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42124e150 exit status 1 <nil> <nil> true [0xc4202fea48 0xc4202fea88 0xc4202feac8] [0xc4202fea48 0xc4202fea88 0xc4202feac8] [0xc4202fea68 0xc4202feab8] [0xc37850 0xc37850] 0xc420cb7500 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1kvd4] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42124e150 exit status 1 <nil> <nil> true [0xc4202fea48 0xc4202fea88 0xc4202feac8] [0xc4202fea48 0xc4202fea88 0xc4202feac8] [0xc4202fea68 0xc4202feab8] [0xc37850 0xc37850] 0xc420cb7500 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421da2060>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 05:33:44.802 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-bcrc2 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 05:33:44.810 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 05:33:44.898 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 05:33:44 GMT 2017]; root of context hierarchy\n2017-03-19 05:33:46.562 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 05:33:46.582 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 05:33:47.241 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 05:33:47.385 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.11]\n2017-03-19 05:33:47.386 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 05:33:47.398 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 05:33:47.434 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.11]:5701\n2017-03-19 05:33:47.434 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 05:33:47.435 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 05:33:47.771 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.11]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 05:33:48.646 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 05:33:48.944 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 05:33:48.955 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 05:33:48.964 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTING\n2017-03-19 05:33:48.967 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 05:33:49.015 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.11]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.11]:5701 - ff76442d-370d-4209-88d5-6f4ea33e3ecf this\n}\n\n2017-03-19 05:33:49.094 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTED\n2017-03-19 05:33:49.101 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.298 seconds (JVM running for 6.191)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 05:33:44.802 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-bcrc2 with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 05:33:44.810 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 05:33:44.898 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 05:33:44 GMT 2017]; root of context hierarchy
2017-03-19 05:33:46.562 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 05:33:46.582 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 05:33:47.241 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 05:33:47.385 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.11]
2017-03-19 05:33:47.386 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 05:33:47.398 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 05:33:47.434 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.11]:5701
2017-03-19 05:33:47.434 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 05:33:47.435 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 05:33:47.771 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.11]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 05:33:48.646 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 05:33:48.944 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 05:33:48.955 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 05:33:48.964 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTING
2017-03-19 05:33:48.967 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 05:33:49.015 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.11]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.11]:5701 - ff76442d-370d-4209-88d5-6f4ea33e3ecf this
}
2017-03-19 05:33:49.094 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTED
2017-03-19 05:33:49.101 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.298 seconds (JVM running for 6.191)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc4212200a0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2gf1s\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 05:25:01 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 05:25:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2gf1s}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 05:25:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 05:25:02 Global memtable on-heap threshold is enabled at 128MB\nINFO 05:25:02 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:25:02 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.6
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.6
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.6
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-2gf1s
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 05:25:01 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 05:25:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2gf1s}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 05:25:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 05:25:02 Global memtable on-heap threshold is enabled at 128MB
INFO 05:25:02 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 05:25:02 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
/unassign /assign @quinton-hoole
My instinct would just be to delete these tests as from my perspective they just create noise. Do you know someone willing to fix and maintain them?
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4269/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421f24730>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.16\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.16\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.16\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-r017k\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 06:50:34 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 06:50:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-r017k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 06:50:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 06:50:35 Global memtable on-heap threshold is enabled at 128MB\nINFO 06:50:35 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:50:35 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.16
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.16
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.16
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-r017k
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 06:50:34 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 06:50:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-r017k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 06:50:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 06:50:35 Global memtable on-heap threshold is enabled at 128MB
INFO 06:50:35 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 06:50:35 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jdfs4] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42153fe30 exit status 1 <nil> <nil> true [0xc42030e3b0 0xc42030e3d8 0xc42030e408] [0xc42030e3b0 0xc42030e3d8 0xc42030e408] [0xc42030e3c8 0xc42030e3f0] [0xc37850 0xc37850] 0xc42105ccc0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jdfs4] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42153fe30 exit status 1 <nil> <nil> true [0xc42030e3b0 0xc42030e3d8 0xc42030e408] [0xc42030e3b0 0xc42030e3d8 0xc42030e408] [0xc42030e3c8 0xc42030e3f0] [0xc37850 0xc37850] 0xc42105ccc0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4219ea520>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 06:30:33.483 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-pgxzz with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-19 06:30:33.491 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 06:30:33.652 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 06:30:33 GMT 2017]; root of context hierarchy\n2017-03-19 06:30:35.656 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 06:30:35.683 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 06:30:36.321 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 06:30:36.450 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.13]\n2017-03-19 06:30:36.451 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 06:30:36.462 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 06:30:36.498 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.13]:5701\n2017-03-19 06:30:36.498 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 06:30:36.498 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 06:30:36.850 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 06:30:37.777 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.2.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 06:30:38.049 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 06:30:38.054 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 06:30:38.067 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTING\n2017-03-19 06:30:38.070 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 06:30:38.090 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.13]:5701 - 0010eb31-e8c1-48c4-8593-a6f7556f5e65 this\n}\n\n2017-03-19 06:30:38.179 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTED\n2017-03-19 06:30:38.182 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.796 seconds (JVM running for 6.775)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 06:30:33.483 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-pgxzz with PID 7 (/bootstrapper.jar started by root in /)
2017-03-19 06:30:33.491 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 06:30:33.652 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 06:30:33 GMT 2017]; root of context hierarchy
2017-03-19 06:30:35.656 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 06:30:35.683 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 06:30:36.321 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 06:30:36.450 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.13]
2017-03-19 06:30:36.451 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 06:30:36.462 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 06:30:36.498 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.13]:5701
2017-03-19 06:30:36.498 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 06:30:36.498 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 06:30:36.850 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 06:30:37.777 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.2.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 06:30:38.049 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 06:30:38.054 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 06:30:38.067 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTING
2017-03-19 06:30:38.070 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 06:30:38.090 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.13]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.13]:5701 - 0010eb31-e8c1-48c4-8593-a6f7556f5e65 this
}
2017-03-19 06:30:38.179 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTED
2017-03-19 06:30:38.182 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.796 seconds (JVM running for 6.775)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4270/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc42084b220>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-03zkt\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 07:31:02 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 07:31:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-03zkt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 07:31:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 07:31:02 Global memtable on-heap threshold is enabled at 128MB\nINFO 07:31:02 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 07:31:02 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.8
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.8
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.8
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-03zkt
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 07:31:02 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 07:31:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-03zkt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 07:31:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 07:31:02 Global memtable on-heap threshold is enabled at 128MB
INFO 07:31:02 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 07:31:02 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420e3f300>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 07:35:35.965 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-j5x34 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 07:35:35.972 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 07:35:36.044 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 07:35:36 GMT 2017]; root of context hierarchy\n2017-03-19 07:35:37.798 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 07:35:37.823 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 07:35:38.438 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 07:35:38.565 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]\n2017-03-19 07:35:38.565 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 07:35:38.577 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 07:35:38.609 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701\n2017-03-19 07:35:38.609 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 07:35:38.609 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 07:35:38.969 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 07:35:39.911 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 07:35:40.188 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 07:35:40.203 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 07:35:40.246 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING\n2017-03-19 07:35:40.247 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 07:35:40.313 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.8]:5701 - a22f9be8-c293-4abf-8aac-e9739a32fa73 this\n}\n\n2017-03-19 07:35:40.393 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED\n2017-03-19 07:35:40.395 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.344 seconds (JVM running for 6.251)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 07:35:35.965 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-j5x34 with PID 5 (/bootstrapper.jar started by root in /)
2017-03-19 07:35:35.972 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 07:35:36.044 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 07:35:36 GMT 2017]; root of context hierarchy
2017-03-19 07:35:37.798 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 07:35:37.823 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 07:35:38.438 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 07:35:38.565 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]
2017-03-19 07:35:38.565 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 07:35:38.577 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 07:35:38.609 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701
2017-03-19 07:35:38.609 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 07:35:38.609 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 07:35:38.969 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 07:35:39.911 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 07:35:40.188 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 07:35:40.203 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 07:35:40.246 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING
2017-03-19 07:35:40.247 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 07:35:40.313 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.8]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.8]:5701 - a22f9be8-c293-4abf-8aac-e9739a32fa73 this
}
2017-03-19 07:35:40.393 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED
2017-03-19 07:35:40.395 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.344 seconds (JVM running for 6.251)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.177.48 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-79mzn] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42175bd70 exit status 1 <nil> <nil> true [0xc420592c28 0xc420592c70 0xc420592cd0] [0xc420592c28 0xc420592c70 0xc420592cd0] [0xc420592c58 0xc420592ca0] [0xc37850 0xc37850] 0xc421770480 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.177.48 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-79mzn] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42175bd70 exit status 1 <nil> <nil> true [0xc420592c28 0xc420592c70 0xc420592cd0] [0xc420592c28 0xc420592c70 0xc420592cd0] [0xc420592c58 0xc420592ca0] [0xc37850 0xc37850] 0xc421770480 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4271/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc4215262a0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.0.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.0.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.0.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-79n2m\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 08:53:51 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 08:53:51 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.15; broadcast_rpc_address=10.180.0.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-79n2m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 08:53:51 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 08:53:52 Global memtable on-heap threshold is enabled at 128MB\nINFO 08:53:52 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 08:53:52 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.0.15
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.0.15
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.15
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.0.15
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-79n2m
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 08:53:51 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 08:53:51 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.15; broadcast_rpc_address=10.180.0.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-79n2m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 08:53:51 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 08:53:52 Global memtable on-heap threshold is enabled at 128MB
INFO 08:53:52 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 08:53:52 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420d44b10>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 08:31:54.322 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-0l7dw with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 08:31:54.330 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 08:31:54.432 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 08:31:54 GMT 2017]; root of context hierarchy\n2017-03-19 08:31:56.003 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 08:31:56.023 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 08:31:56.690 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 08:31:56.797 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.8]\n2017-03-19 08:31:56.798 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 08:31:56.811 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 08:31:56.843 INFO 6 --- [ main] com.hazelcast.system : [10.180.0.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.8]:5701\n2017-03-19 08:31:56.843 INFO 6 --- [ main] com.hazelcast.system : [10.180.0.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 08:31:56.844 INFO 6 --- [ main] com.hazelcast.system : [10.180.0.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 08:31:57.166 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.0.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 08:31:58.211 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.0.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 08:31:58.469 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.0.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 08:31:58.477 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.0.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 08:31:58.486 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.0.8]:5701 [someGroup] [3.7.5] [10.180.0.8]:5701 is STARTING\n2017-03-19 08:31:58.487 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.0.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 08:31:58.535 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.0.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.0.8]:5701 - a893000a-9e3a-411a-9e79-cc3c3a995d6b this\n}\n\n2017-03-19 08:31:58.635 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.0.8]:5701 [someGroup] [3.7.5] [10.180.0.8]:5701 is STARTED\n2017-03-19 08:31:58.642 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.346 seconds (JVM running for 6.386)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 08:31:54.322 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-0l7dw with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 08:31:54.330 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 08:31:54.432 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 08:31:54 GMT 2017]; root of context hierarchy
2017-03-19 08:31:56.003 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 08:31:56.023 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 08:31:56.690 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 08:31:56.797 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.8]
2017-03-19 08:31:56.798 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 08:31:56.811 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 08:31:56.843 INFO 6 --- [ main] com.hazelcast.system : [10.180.0.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.8]:5701
2017-03-19 08:31:56.843 INFO 6 --- [ main] com.hazelcast.system : [10.180.0.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 08:31:56.844 INFO 6 --- [ main] com.hazelcast.system : [10.180.0.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 08:31:57.166 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.0.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 08:31:58.211 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.0.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 08:31:58.469 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.0.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 08:31:58.477 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.0.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 08:31:58.486 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.0.8]:5701 [someGroup] [3.7.5] [10.180.0.8]:5701 is STARTING
2017-03-19 08:31:58.487 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.0.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 08:31:58.535 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.0.8]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.0.8]:5701 - a893000a-9e3a-411a-9e79-cc3c3a995d6b this
}
2017-03-19 08:31:58.635 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.0.8]:5701 [someGroup] [3.7.5] [10.180.0.8]:5701 is STARTED
2017-03-19 08:31:58.642 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.346 seconds (JVM running for 6.386)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-s7lz7] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42111a870 exit status 1 <nil> <nil> true [0xc420038110 0xc420038138 0xc420038160] [0xc420038110 0xc420038138 0xc420038160] [0xc420038130 0xc420038150] [0xc37850 0xc37850] 0xc420a1aba0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-s7lz7] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42111a870 exit status 1 <nil> <nil> true [0xc420038110 0xc420038138 0xc420038160] [0xc420038110 0xc420038138 0xc420038160] [0xc420038130 0xc420038150] [0xc37850 0xc37850] 0xc420a1aba0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4272/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421d3c030>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 10:01:23.827 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-7xd6c with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 10:01:23.842 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 10:01:23.940 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 10:01:23 GMT 2017]; root of context hierarchy\n2017-03-19 10:01:25.673 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 10:01:25.710 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 10:01:26.387 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 10:01:26.516 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.22]\n2017-03-19 10:01:26.516 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 10:01:26.529 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 10:01:26.559 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.22]:5701\n2017-03-19 10:01:26.559 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 10:01:26.559 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 10:01:26.860 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.22]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 10:01:27.672 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 10:01:27.976 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 10:01:27.984 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 10:01:28.012 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.22]:5701 [someGroup] [3.7.5] [10.180.1.22]:5701 is STARTING\n2017-03-19 10:01:28.017 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 10:01:28.045 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.22]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.22]:5701 - 83f807e8-4a98-4d62-80e7-38d5b33e5343 this\n}\n\n2017-03-19 10:01:28.120 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.22]:5701 [someGroup] [3.7.5] [10.180.1.22]:5701 is STARTED\n2017-03-19 10:01:28.125 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.241 seconds (JVM running for 6.111)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 10:01:23.827 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-7xd6c with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 10:01:23.842 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 10:01:23.940 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 10:01:23 GMT 2017]; root of context hierarchy
2017-03-19 10:01:25.673 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 10:01:25.710 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 10:01:26.387 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 10:01:26.516 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.22]
2017-03-19 10:01:26.516 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 10:01:26.529 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 10:01:26.559 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.22]:5701
2017-03-19 10:01:26.559 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 10:01:26.559 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 10:01:26.860 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.22]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 10:01:27.672 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 10:01:27.976 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 10:01:27.984 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 10:01:28.012 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.22]:5701 [someGroup] [3.7.5] [10.180.1.22]:5701 is STARTING
2017-03-19 10:01:28.017 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 10:01:28.045 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.22]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.22]:5701 - 83f807e8-4a98-4d62-80e7-38d5b33e5343 this
}
2017-03-19 10:01:28.120 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.22]:5701 [someGroup] [3.7.5] [10.180.1.22]:5701 is STARTED
2017-03-19 10:01:28.125 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.241 seconds (JVM running for 6.111)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-x438v] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f4fbf0 exit status 1 <nil> <nil> true [0xc42075ed40 0xc42075ed58 0xc42075ed70] [0xc42075ed40 0xc42075ed58 0xc42075ed70] [0xc42075ed50 0xc42075ed68] [0xc37850 0xc37850] 0xc4212f5f80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-x438v] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420f4fbf0 exit status 1 <nil> <nil> true [0xc42075ed40 0xc42075ed58 0xc42075ed70] [0xc42075ed40 0xc42075ed58 0xc42075ed70] [0xc42075ed50 0xc42075ed68] [0xc37850 0xc37850] 0xc4212f5f80 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421cdc450>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-dnvpn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 09:53:19 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 09:53:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dnvpn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 09:53:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 09:53:19 Global memtable on-heap threshold is enabled at 128MB\nINFO 09:53:19 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:53:19 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.9
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.9
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.9
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-dnvpn
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 09:53:19 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 09:53:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dnvpn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 09:53:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 09:53:19 Global memtable on-heap threshold is enabled at 128MB
INFO 09:53:19 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 09:53:19 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4273/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420f729d0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 10:56:10.816 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-n223b with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 10:56:10.832 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 10:56:10.920 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 10:56:10 GMT 2017]; root of context hierarchy\n2017-03-19 10:56:12.694 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 10:56:12.713 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 10:56:13.274 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 10:56:13.400 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]\n2017-03-19 10:56:13.400 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 10:56:13.412 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 10:56:13.448 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701\n2017-03-19 10:56:13.448 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 10:56:13.448 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 10:56:13.838 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 10:56:14.690 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 10:56:14.951 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 10:56:14.965 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 10:56:14.989 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING\n2017-03-19 10:56:14.996 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 10:56:15.029 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.17]:5701 - 9fff8020-c9ef-4ee1-8520-6ebbcb482b59 this\n}\n\n2017-03-19 10:56:15.093 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED\n2017-03-19 10:56:15.105 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.313 seconds (JVM running for 6.077)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 10:56:10.816 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-n223b with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 10:56:10.832 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 10:56:10.920 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 10:56:10 GMT 2017]; root of context hierarchy
2017-03-19 10:56:12.694 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 10:56:12.713 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 10:56:13.274 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 10:56:13.400 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]
2017-03-19 10:56:13.400 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 10:56:13.412 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 10:56:13.448 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701
2017-03-19 10:56:13.448 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 10:56:13.448 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 10:56:13.838 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 10:56:14.690 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 10:56:14.951 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 10:56:14.965 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 10:56:14.989 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING
2017-03-19 10:56:14.996 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 10:56:15.029 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.17]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.17]:5701 - 9fff8020-c9ef-4ee1-8520-6ebbcb482b59 this
}
2017-03-19 10:56:15.093 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED
2017-03-19 10:56:15.105 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.313 seconds (JVM running for 6.077)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421df24d0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.18\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.18\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.18\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.18\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-rml51\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 11:11:19 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 11:11:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.18; broadcast_rpc_address=10.180.2.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-rml51}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 11:11:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 11:11:19 Global memtable on-heap threshold is enabled at 128MB\nINFO 11:11:19 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:11:19 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.18
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.18
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.18
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.18
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-rml51
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 11:11:19 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 11:11:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.18; broadcast_rpc_address=10.180.2.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-rml51}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 11:11:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 11:11:19 Global memtable on-heap threshold is enabled at 128MB
INFO 11:11:19 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 11:11:19 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-h3spn] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421453920 exit status 1 <nil> <nil> true [0xc4200380e0 0xc420038100 0xc420038118] [0xc4200380e0 0xc420038100 0xc420038118] [0xc4200380f8 0xc420038110] [0xc37850 0xc37850] 0xc421232600 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-h3spn] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc421453920 exit status 1 <nil> <nil> true [0xc4200380e0 0xc420038100 0xc420038118] [0xc4200380e0 0xc420038100 0xc420038118] [0xc4200380f8 0xc420038110] [0xc37850 0xc37850] 0xc421232600 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4274/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1gkcb] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4211c45d0 exit status 1 <nil> <nil> true [0xc4202b20f0 0xc4202b2108 0xc4202b2120] [0xc4202b20f0 0xc4202b2108 0xc4202b2120] [0xc4202b2100 0xc4202b2118] [0xc37850 0xc37850] 0xc4212a5140 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1gkcb] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4211c45d0 exit status 1 <nil> <nil> true [0xc4202b20f0 0xc4202b2108 0xc4202b2120] [0xc4202b20f0 0xc4202b2108 0xc4202b2120] [0xc4202b2100 0xc4202b2118] [0xc37850 0xc37850] 0xc4212a5140 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421be25d0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-56v1b\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 11:59:49 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 11:59:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.8; broadcast_rpc_address=10.180.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-56v1b}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 11:59:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 11:59:49 Global memtable on-heap threshold is enabled at 128MB\nINFO 11:59:49 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:59:49 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.8
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.8
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.8
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.8
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-56v1b
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 11:59:49 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 11:59:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.8; broadcast_rpc_address=10.180.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-56v1b}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 11:59:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 11:59:49 Global memtable on-heap threshold is enabled at 128MB
INFO 11:59:49 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 11:59:49 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421bd26b0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 12:08:23.791 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-kdzft with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 12:08:23.807 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 12:08:23.984 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 12:08:23 GMT 2017]; root of context hierarchy\n2017-03-19 12:08:25.878 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 12:08:25.906 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 12:08:26.676 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 12:08:26.798 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-19 12:08:26.799 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 12:08:26.810 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 12:08:26.849 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-19 12:08:26.850 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 12:08:26.850 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 12:08:27.236 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 12:08:28.284 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 12:08:28.588 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 12:08:28.596 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 12:08:28.613 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-19 12:08:28.616 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 12:08:28.647 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - 61a258c6-8207-4a14-b1e7-6c6d5c05a21f this\n}\n\n2017-03-19 12:08:28.706 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-19 12:08:28.709 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 6.062 seconds (JVM running for 6.927)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 12:08:23.791 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-kdzft with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 12:08:23.807 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 12:08:23.984 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 12:08:23 GMT 2017]; root of context hierarchy
2017-03-19 12:08:25.878 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 12:08:25.906 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 12:08:26.676 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 12:08:26.798 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
2017-03-19 12:08:26.799 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 12:08:26.810 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 12:08:26.849 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
2017-03-19 12:08:26.850 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 12:08:26.850 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 12:08:27.236 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 12:08:28.284 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 12:08:28.588 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 12:08:28.596 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 12:08:28.613 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
2017-03-19 12:08:28.616 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 12:08:28.647 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.14]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.14]:5701 - 61a258c6-8207-4a14-b1e7-6c6d5c05a21f this
}
2017-03-19 12:08:28.706 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
2017-03-19 12:08:28.709 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 6.062 seconds (JVM running for 6.927)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4275/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4214769a0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 13:08:29.622 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-s2f8r with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-19 13:08:29.630 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 13:08:29.754 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 13:08:29 GMT 2017]; root of context hierarchy\n2017-03-19 13:08:31.557 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 13:08:31.579 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 13:08:32.204 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 13:08:32.333 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.10]\n2017-03-19 13:08:32.334 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 13:08:32.347 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 13:08:32.383 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.10]:5701\n2017-03-19 13:08:32.383 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 13:08:32.383 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 13:08:32.753 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.10]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 13:08:33.595 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.2.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 13:08:33.873 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 13:08:33.881 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 13:08:33.896 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTING\n2017-03-19 13:08:33.899 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 13:08:33.950 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.10]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.10]:5701 - bddbac22-8bb7-44bf-9283-d9e31fa65b3c this\n}\n\n2017-03-19 13:08:34.047 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTED\n2017-03-19 13:08:34.053 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.531 seconds (JVM running for 6.418)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 13:08:29.622 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-s2f8r with PID 7 (/bootstrapper.jar started by root in /)
2017-03-19 13:08:29.630 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 13:08:29.754 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 13:08:29 GMT 2017]; root of context hierarchy
2017-03-19 13:08:31.557 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 13:08:31.579 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 13:08:32.204 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 13:08:32.333 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.10]
2017-03-19 13:08:32.334 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 13:08:32.347 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 13:08:32.383 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.10]:5701
2017-03-19 13:08:32.383 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 13:08:32.383 INFO 7 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 13:08:32.753 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.10]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 13:08:33.595 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.2.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 13:08:33.873 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 13:08:33.881 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 13:08:33.896 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTING
2017-03-19 13:08:33.899 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 13:08:33.950 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.10]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.10]:5701 - bddbac22-8bb7-44bf-9283-d9e31fa65b3c this
}
2017-03-19 13:08:34.047 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTED
2017-03-19 13:08:34.053 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.531 seconds (JVM running for 6.418)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.194.253 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-clwmk] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420d02570 exit status 1 <nil> <nil> true [0xc420038ce0 0xc420038cf8 0xc420038d10] [0xc420038ce0 0xc420038cf8 0xc420038d10] [0xc420038cf0 0xc420038d08] [0xc37850 0xc37850] 0xc4216532c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.194.253 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-clwmk] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420d02570 exit status 1 <nil> <nil> true [0xc420038ce0 0xc420038cf8 0xc420038d10] [0xc420038ce0 0xc420038cf8 0xc420038d10] [0xc420038cf0 0xc420038d08] [0xc37850 0xc37850] 0xc4216532c0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421477270>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-ncz2j\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 13:03:28 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 13:03:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ncz2j}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 13:03:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 13:03:29 Global memtable on-heap threshold is enabled at 128MB\nINFO 13:03:29 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:03:29 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.8
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.8
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.8
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-ncz2j
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 13:03:28 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 13:03:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ncz2j}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 13:03:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 13:03:29 Global memtable on-heap threshold is enabled at 128MB
INFO 13:03:29 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 13:03:29 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4276/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421b949e0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 14:01:00.408 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-cww5w with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 14:01:00.415 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 14:01:00.534 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 14:01:00 GMT 2017]; root of context hierarchy\n2017-03-19 14:01:02.315 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 14:01:02.339 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 14:01:03.086 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 14:01:03.190 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.9]\n2017-03-19 14:01:03.191 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 14:01:03.205 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 14:01:03.236 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.9]:5701\n2017-03-19 14:01:03.237 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 14:01:03.237 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 14:01:03.588 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 14:01:04.466 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 14:01:04.743 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 14:01:04.758 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 14:01:04.780 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTING\n2017-03-19 14:01:04.785 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 14:01:04.813 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.9]:5701 - 885df031-3fe6-44f3-8b46-fa418d6858b4 this\n}\n\n2017-03-19 14:01:04.903 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTED\n2017-03-19 14:01:04.905 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.567 seconds (JVM running for 6.418)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 14:01:00.408 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-cww5w with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 14:01:00.415 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 14:01:00.534 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 14:01:00 GMT 2017]; root of context hierarchy
2017-03-19 14:01:02.315 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 14:01:02.339 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 14:01:03.086 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 14:01:03.190 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.9]
2017-03-19 14:01:03.191 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 14:01:03.205 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 14:01:03.236 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.9]:5701
2017-03-19 14:01:03.237 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 14:01:03.237 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 14:01:03.588 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 14:01:04.466 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 14:01:04.743 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 14:01:04.758 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 14:01:04.780 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTING
2017-03-19 14:01:04.785 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 14:01:04.813 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.9]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.9]:5701 - 885df031-3fe6-44f3-8b46-fa418d6858b4 this
}
2017-03-19 14:01:04.903 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTED
2017-03-19 14:01:04.905 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.567 seconds (JVM running for 6.418)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421b4f300>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.19\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.19\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.19\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.19\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-cn3lk\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 14:28:24 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 14:28:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.19; broadcast_rpc_address=10.180.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-cn3lk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 14:28:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 14:28:24 Global memtable on-heap threshold is enabled at 128MB\nINFO 14:28:24 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:28:24 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.19
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.19
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.19
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.19
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-cn3lk
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 14:28:24 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 14:28:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.19; broadcast_rpc_address=10.180.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-cn3lk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 14:28:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 14:28:24 Global memtable on-heap threshold is enabled at 128MB
INFO 14:28:24 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 14:28:24 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.194.253 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-70pg1] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420d34960 exit status 1 <nil> <nil> true [0xc4204a48e0 0xc4204a4900 0xc4204a4920] [0xc4204a48e0 0xc4204a4900 0xc4204a4920] [0xc4204a48f0 0xc4204a4918] [0xc37850 0xc37850] 0xc420816120 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.194.253 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-70pg1] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420d34960 exit status 1 <nil> <nil> true [0xc4204a48e0 0xc4204a4900 0xc4204a4920] [0xc4204a48e0 0xc4204a4900 0xc4204a4920] [0xc4204a48f0 0xc4204a4918] [0xc37850 0xc37850] 0xc420816120 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4277/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ckh22] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420cdf410 exit status 1 <nil> <nil> true [0xc4200380f8 0xc4200381c8 0xc420038200] [0xc4200380f8 0xc4200381c8 0xc420038200] [0xc4200381c0 0xc4200381f8] [0xc37850 0xc37850] 0xc420b7cd80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ckh22] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420cdf410 exit status 1 <nil> <nil> true [0xc4200380f8 0xc4200381c8 0xc420038200] [0xc4200380f8 0xc4200381c8 0xc420038200] [0xc4200381c0 0xc4200381f8] [0xc37850 0xc37850] 0xc420b7cd80 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4213d21f0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 15:15:02.650 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-pp7hk with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 15:15:02.658 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 15:15:02.805 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 15:15:02 GMT 2017]; root of context hierarchy\n2017-03-19 15:15:04.643 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 15:15:04.668 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 15:15:05.350 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 15:15:05.477 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]\n2017-03-19 15:15:05.478 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 15:15:05.489 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 15:15:05.525 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701\n2017-03-19 15:15:05.526 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 15:15:05.526 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 15:15:05.911 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 15:15:07.158 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 15:15:07.460 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 15:15:07.468 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 15:15:07.479 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING\n2017-03-19 15:15:07.481 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 15:15:07.539 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.15]:5701 - c43501c7-dbe2-4321-9fcc-9b75d633bab2 this\n}\n\n2017-03-19 15:15:07.627 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED\n2017-03-19 15:15:07.639 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 6.23 seconds (JVM running for 7.237)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 15:15:02.650 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-pp7hk with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 15:15:02.658 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 15:15:02.805 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 15:15:02 GMT 2017]; root of context hierarchy
2017-03-19 15:15:04.643 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 15:15:04.668 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 15:15:05.350 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 15:15:05.477 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]
2017-03-19 15:15:05.478 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 15:15:05.489 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 15:15:05.525 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701
2017-03-19 15:15:05.526 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 15:15:05.526 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 15:15:05.911 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 15:15:07.158 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 15:15:07.460 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 15:15:07.468 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 15:15:07.479 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING
2017-03-19 15:15:07.481 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 15:15:07.539 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.15]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.15]:5701 - c43501c7-dbe2-4321-9fcc-9b75d633bab2 this
}
2017-03-19 15:15:07.627 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED
2017-03-19 15:15:07.639 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 6.23 seconds (JVM running for 7.237)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421ec2840>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2wfc8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 15:35:07 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 15:35:07 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2wfc8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 15:35:07 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 15:35:07 Global memtable on-heap threshold is enabled at 128MB\nINFO 15:35:07 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:35:07 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.10
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.10
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.10
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-2wfc8
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 15:35:07 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 15:35:07 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2wfc8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 15:35:07 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 15:35:07 Global memtable on-heap threshold is enabled at 128MB
INFO 15:35:07 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 15:35:07 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4278/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420b45640>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-mwtjn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 16:27:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 16:27:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-mwtjn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 16:27:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 16:27:41 Global memtable on-heap threshold is enabled at 128MB\nINFO 16:27:41 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 16:27:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.14
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.14
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.14
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-mwtjn
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 16:27:40 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 16:27:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-mwtjn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 16:27:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 16:27:41 Global memtable on-heap threshold is enabled at 128MB
INFO 16:27:41 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 16:27:41 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.147.5 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b9p9f] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ee2720 exit status 1 <nil> <nil> true [0xc4205b83e0 0xc4205b8400 0xc4205b8420] [0xc4205b83e0 0xc4205b8400 0xc4205b8420] [0xc4205b83f8 0xc4205b8418] [0xc37850 0xc37850] 0xc42135d980 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.147.5 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b9p9f] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420ee2720 exit status 1 <nil> <nil> true [0xc4205b83e0 0xc4205b8400 0xc4205b8420] [0xc4205b83e0 0xc4205b8400 0xc4205b8420] [0xc4205b83f8 0xc4205b8418] [0xc37850 0xc37850] 0xc42135d980 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421a6c240>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 16:35:19.274 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-0dl98 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 16:35:19.291 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 16:35:19.388 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 16:35:19 GMT 2017]; root of context hierarchy\n2017-03-19 16:35:21.076 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 16:35:21.094 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 16:35:21.730 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 16:35:21.868 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-19 16:35:21.869 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 16:35:21.882 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 16:35:21.919 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-19 16:35:21.919 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 16:35:21.919 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 16:35:22.309 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 16:35:23.332 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 16:35:23.597 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 16:35:23.600 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 16:35:23.626 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-19 16:35:23.627 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 16:35:23.662 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - a3004aeb-13ad-4d4e-a36f-d87d7f8756af this\n}\n\n2017-03-19 16:35:23.739 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-19 16:35:23.744 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.506 seconds (JVM running for 6.402)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 16:35:19.274 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-0dl98 with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 16:35:19.291 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 16:35:19.388 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 16:35:19 GMT 2017]; root of context hierarchy
2017-03-19 16:35:21.076 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 16:35:21.094 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 16:35:21.730 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 16:35:21.868 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
2017-03-19 16:35:21.869 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 16:35:21.882 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 16:35:21.919 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
2017-03-19 16:35:21.919 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 16:35:21.919 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 16:35:22.309 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 16:35:23.332 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 16:35:23.597 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 16:35:23.600 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 16:35:23.626 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
2017-03-19 16:35:23.627 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 16:35:23.662 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.16]:5701 - a3004aeb-13ad-4d4e-a36f-d87d7f8756af this
}
2017-03-19 16:35:23.739 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
2017-03-19 16:35:23.744 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.506 seconds (JVM running for 6.402)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4279/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420e11060>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-np6m7\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 17:34:05 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 17:34:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-np6m7}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 17:34:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 17:34:05 Global memtable on-heap threshold is enabled at 128MB\nINFO 17:34:05 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:34:05 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.14
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-np6m7
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 17:34:05 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 17:34:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-np6m7}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 17:34:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 17:34:05 Global memtable on-heap threshold is enabled at 128MB
INFO 17:34:05 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 17:34:05 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc421be0470>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 17:37:02.673 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-mddk0 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 17:37:02.695 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 17:37:02.845 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 17:37:02 GMT 2017]; root of context hierarchy\n2017-03-19 17:37:04.810 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 17:37:04.836 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 17:37:05.522 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 17:37:05.656 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]\n2017-03-19 17:37:05.657 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 17:37:05.670 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 17:37:05.705 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701\n2017-03-19 17:37:05.706 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 17:37:05.706 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 17:37:06.078 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 17:37:06.977 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 17:37:07.256 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 17:37:07.262 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 17:37:07.283 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING\n2017-03-19 17:37:07.284 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 17:37:07.339 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.15]:5701 - 833c116c-b691-48a5-9a22-de95f7b23015 this\n}\n\n2017-03-19 17:37:07.416 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED\n2017-03-19 17:37:07.427 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.807 seconds (JVM running for 6.77)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 17:37:02.673 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-mddk0 with PID 5 (/bootstrapper.jar started by root in /)
2017-03-19 17:37:02.695 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 17:37:02.845 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 17:37:02 GMT 2017]; root of context hierarchy
2017-03-19 17:37:04.810 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 17:37:04.836 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 17:37:05.522 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 17:37:05.656 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]
2017-03-19 17:37:05.657 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 17:37:05.670 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 17:37:05.705 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701
2017-03-19 17:37:05.706 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 17:37:05.706 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 17:37:06.078 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 17:37:06.977 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 17:37:07.256 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 17:37:07.262 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 17:37:07.283 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING
2017-03-19 17:37:07.284 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 17:37:07.339 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.15]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.15]:5701 - 833c116c-b691-48a5-9a22-de95f7b23015 this
}
2017-03-19 17:37:07.416 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED
2017-03-19 17:37:07.427 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.807 seconds (JVM running for 6.77)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-3d4l3] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4216dbb00 exit status 1 <nil> <nil> true [0xc4202b4f00 0xc4202b4f20 0xc4202b4f58] [0xc4202b4f00 0xc4202b4f20 0xc4202b4f58] [0xc4202b4f18 0xc4202b4f40] [0xc37850 0xc37850] 0xc420ca4960 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-3d4l3] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4216dbb00 exit status 1 <nil> <nil> true [0xc4202b4f00 0xc4202b4f20 0xc4202b4f58] [0xc4202b4f00 0xc4202b4f20 0xc4202b4f58] [0xc4202b4f18 0xc4202b4f40] [0xc37850 0xc37850] 0xc420ca4960 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4281/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420c2e450>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.18\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.18\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.18\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.18\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-26nrz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 19:07:39 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 19:07:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.18; broadcast_rpc_address=10.180.1.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-26nrz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 19:07:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 19:07:40 Global memtable on-heap threshold is enabled at 128MB\nINFO 19:07:40 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 19:07:40 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.18
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.18
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.18
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.18
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-26nrz
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 19:07:39 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 19:07:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.18; broadcast_rpc_address=10.180.1.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-26nrz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 19:07:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 19:07:40 Global memtable on-heap threshold is enabled at 128MB
INFO 19:07:40 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 19:07:40 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc42132c030>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 18:46:52.171 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-2lsqg with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 18:46:52.178 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 18:46:52.259 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 18:46:52 GMT 2017]; root of context hierarchy\n2017-03-19 18:46:53.948 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 18:46:54.042 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 18:46:54.632 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 18:46:54.766 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.13]\n2017-03-19 18:46:54.767 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 18:46:54.786 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 18:46:54.837 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.13]:5701\n2017-03-19 18:46:54.837 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 18:46:54.837 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 18:46:55.163 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 18:46:55.982 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 18:46:56.288 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 18:46:56.303 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 18:46:56.340 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTING\n2017-03-19 18:46:56.341 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 18:46:56.365 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.13]:5701 - 7a105e70-7ac8-4a33-b0b3-c179fc820efe this\n}\n\n2017-03-19 18:46:56.431 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTED\n2017-03-19 18:46:56.434 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.226 seconds (JVM running for 6.13)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 18:46:52.171 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-2lsqg with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 18:46:52.178 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 18:46:52.259 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 18:46:52 GMT 2017]; root of context hierarchy
2017-03-19 18:46:53.948 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 18:46:54.042 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 18:46:54.632 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 18:46:54.766 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.13]
2017-03-19 18:46:54.767 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 18:46:54.786 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 18:46:54.837 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.13]:5701
2017-03-19 18:46:54.837 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 18:46:54.837 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 18:46:55.163 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 18:46:55.982 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 18:46:56.288 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 18:46:56.303 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 18:46:56.340 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTING
2017-03-19 18:46:56.341 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 18:46:56.365 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.13]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.13]:5701 - 7a105e70-7ac8-4a33-b0b3-c179fc820efe this
}
2017-03-19 18:46:56.431 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTED
2017-03-19 18:46:56.434 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.226 seconds (JVM running for 6.13)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ct0b4] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4210bc030 exit status 1 <nil> <nil> true [0xc420034c60 0xc420034c80 0xc420034ca0] [0xc420034c60 0xc420034c80 0xc420034ca0] [0xc420034c70 0xc420034c98] [0xc37850 0xc37850] 0xc421081440 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ct0b4] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4210bc030 exit status 1 <nil> <nil> true [0xc420034c60 0xc420034c80 0xc420034ca0] [0xc420034c60 0xc420034c80 0xc420034ca0] [0xc420034c70 0xc420034c98] [0xc37850 0xc37850] 0xc421081440 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4282/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420f837a0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 19:48:12.451 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-209cz with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 19:48:12.459 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 19:48:12.539 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 19:48:12 GMT 2017]; root of context hierarchy\n2017-03-19 19:48:14.403 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 19:48:14.429 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 19:48:15.013 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 19:48:15.128 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.5]\n2017-03-19 19:48:15.129 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 19:48:15.141 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 19:48:15.174 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.5]:5701\n2017-03-19 19:48:15.175 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 19:48:15.175 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 19:48:15.510 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.5]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 19:48:16.377 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.5]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 19:48:16.650 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 19:48:16.664 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 19:48:16.674 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTING\n2017-03-19 19:48:16.676 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.5]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 19:48:16.732 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.5]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.5]:5701 - c1b13e1a-3a1b-42f0-a0bf-acbb6b0a5bad this\n}\n\n2017-03-19 19:48:16.846 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTED\n2017-03-19 19:48:16.858 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.42 seconds (JVM running for 6.316)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 19:48:12.451 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-209cz with PID 6 (/bootstrapper.jar started by root in /)
2017-03-19 19:48:12.459 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 19:48:12.539 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 19:48:12 GMT 2017]; root of context hierarchy
2017-03-19 19:48:14.403 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 19:48:14.429 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 19:48:15.013 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 19:48:15.128 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.5]
2017-03-19 19:48:15.129 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 19:48:15.141 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 19:48:15.174 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.5]:5701
2017-03-19 19:48:15.175 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 19:48:15.175 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.5]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 19:48:15.510 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.5]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 19:48:16.377 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.5]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 19:48:16.650 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 19:48:16.664 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 19:48:16.674 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTING
2017-03-19 19:48:16.676 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.5]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 19:48:16.732 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.5]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.5]:5701 - c1b13e1a-3a1b-42f0-a0bf-acbb6b0a5bad this
}
2017-03-19 19:48:16.846 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTED
2017-03-19 19:48:16.858 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.42 seconds (JVM running for 6.316)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc42155e680>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-s3s5k\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 20:03:06 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 20:03:06 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-s3s5k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 20:03:06 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 20:03:06 Global memtable on-heap threshold is enabled at 128MB\nINFO 20:03:06 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 20:03:06 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.6
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.6
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.6
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-s3s5k
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 20:03:06 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 20:03:06 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-s3s5k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 20:03:06 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 20:03:06 Global memtable on-heap threshold is enabled at 128MB
INFO 20:03:06 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 20:03:06 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.79.60 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vfsq2] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420d5aea0 exit status 1 <nil> <nil> true [0xc420534008 0xc420534020 0xc420534058] [0xc420534008 0xc420534020 0xc420534058] [0xc420534018 0xc420534048] [0xc37850 0xc37850] 0xc4215603c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.79.60 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vfsq2] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420d5aea0 exit status 1 <nil> <nil> true [0xc420534008 0xc420534020 0xc420534058] [0xc420534008 0xc420534020 0xc420534058] [0xc420534018 0xc420534048] [0xc37850 0xc37850] 0xc4215603c0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4283/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4212c21b0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 21:15:16.329 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-c0sbm with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 21:15:16.341 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 21:15:16.538 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 21:15:16 GMT 2017]; root of context hierarchy\n2017-03-19 21:15:17.813 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 21:15:17.836 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 21:15:18.447 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 21:15:18.538 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]\n2017-03-19 21:15:18.539 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 21:15:18.548 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 21:15:18.583 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701\n2017-03-19 21:15:18.583 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 21:15:18.583 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 21:15:18.875 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 21:15:19.627 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 21:15:19.881 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 21:15:19.888 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 21:15:19.914 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING\n2017-03-19 21:15:19.920 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 21:15:19.982 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.17]:5701 - 6d8d52d7-6900-4708-a937-f28510392440 this\n}\n\n2017-03-19 21:15:20.039 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED\n2017-03-19 21:15:20.040 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 4.587 seconds (JVM running for 5.517)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 21:15:16.329 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-c0sbm with PID 5 (/bootstrapper.jar started by root in /)
2017-03-19 21:15:16.341 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 21:15:16.538 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 21:15:16 GMT 2017]; root of context hierarchy
2017-03-19 21:15:17.813 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 21:15:17.836 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 21:15:18.447 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 21:15:18.538 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]
2017-03-19 21:15:18.539 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 21:15:18.548 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 21:15:18.583 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701
2017-03-19 21:15:18.583 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 21:15:18.583 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 21:15:18.875 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 21:15:19.627 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 21:15:19.881 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 21:15:19.888 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 21:15:19.914 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING
2017-03-19 21:15:19.920 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 21:15:19.982 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.17]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.17]:5701 - 6d8d52d7-6900-4708-a937-f28510392440 this
}
2017-03-19 21:15:20.039 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED
2017-03-19 21:15:20.040 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 4.587 seconds (JVM running for 5.517)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ht21q] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ecf6e0 exit status 1 <nil> <nil> true [0xc42021dd10 0xc42021dd28 0xc42021dd40] [0xc42021dd10 0xc42021dd28 0xc42021dd40] [0xc42021dd20 0xc42021dd38] [0xc37850 0xc37850] 0xc420ad5740 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ht21q] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420ecf6e0 exit status 1 <nil> <nil> true [0xc42021dd10 0xc42021dd28 0xc42021dd40] [0xc42021dd10 0xc42021dd28 0xc42021dd40] [0xc42021dd20 0xc42021dd38] [0xc37850 0xc37850] 0xc420ad5740 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420d05000>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-bfkx2\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 21:05:09 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 21:05:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bfkx2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 21:05:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 21:05:09 Global memtable on-heap threshold is enabled at 128MB\nINFO 21:05:09 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 21:05:09 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.11
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.11
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.11
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-bfkx2
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 21:05:09 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 21:05:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bfkx2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 21:05:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 21:05:09 Global memtable on-heap threshold is enabled at 128MB
INFO 21:05:09 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 21:05:09 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4284/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc42085ef10>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 22:02:47.145 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-j5v8s with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 22:02:47.153 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 22:02:47.258 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 22:02:47 GMT 2017]; root of context hierarchy\n2017-03-19 22:02:48.908 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 22:02:48.929 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 22:02:49.579 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 22:02:49.712 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.10]\n2017-03-19 22:02:49.713 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 22:02:49.727 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 22:02:49.762 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.10]:5701\n2017-03-19 22:02:49.763 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 22:02:49.763 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 22:02:50.234 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.10]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 22:02:51.205 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 22:02:51.509 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 22:02:51.516 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 22:02:51.548 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTING\n2017-03-19 22:02:51.554 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 22:02:51.603 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.10]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.10]:5701 - a4abb578-77b0-42bd-a19f-292162b2c52a this\n}\n\n2017-03-19 22:02:51.688 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTED\n2017-03-19 22:02:51.695 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.663 seconds (JVM running for 6.554)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 22:02:47.145 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-j5v8s with PID 5 (/bootstrapper.jar started by root in /)
2017-03-19 22:02:47.153 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 22:02:47.258 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 22:02:47 GMT 2017]; root of context hierarchy
2017-03-19 22:02:48.908 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 22:02:48.929 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 22:02:49.579 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 22:02:49.712 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.10]
2017-03-19 22:02:49.713 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 22:02:49.727 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 22:02:49.762 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.10]:5701
2017-03-19 22:02:49.763 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 22:02:49.763 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 22:02:50.234 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.10]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 22:02:51.205 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 22:02:51.509 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 22:02:51.516 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 22:02:51.548 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTING
2017-03-19 22:02:51.554 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 22:02:51.603 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.10]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.10]:5701 - a4abb578-77b0-42bd-a19f-292162b2c52a this
}
2017-03-19 22:02:51.688 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTED
2017-03-19 22:02:51.695 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.663 seconds (JVM running for 6.554)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc42141c0b0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0q183\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 22:17:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 22:17:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0q183}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 22:17:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 22:17:40 Global memtable on-heap threshold is enabled at 128MB\nINFO 22:17:40 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 22:17:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.11
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.11
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.11
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-0q183
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 22:17:40 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 22:17:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0q183}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 22:17:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 22:17:40 Global memtable on-heap threshold is enabled at 128MB
INFO 22:17:40 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 22:17:41 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.29.172 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jmnmm] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4216c73b0 exit status 1 <nil> <nil> true [0xc42113a160 0xc42113a178 0xc42113a190] [0xc42113a160 0xc42113a178 0xc42113a190] [0xc42113a170 0xc42113a188] [0xc37850 0xc37850] 0xc420f4e180 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.29.172 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jmnmm] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4216c73b0 exit status 1 <nil> <nil> true [0xc42113a160 0xc42113a178 0xc42113a190] [0xc42113a160 0xc42113a178 0xc42113a190] [0xc42113a170 0xc42113a188] [0xc37850 0xc37850] 0xc420f4e180 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4285/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.180.50 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-rtnzt] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420df7b00 exit status 1 <nil> <nil> true [0xc42032a648 0xc42032a660 0xc42032a678] [0xc42032a648 0xc42032a660 0xc42032a678] [0xc42032a658 0xc42032a670] [0xc37850 0xc37850] 0xc4211a3620 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.180.50 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-rtnzt] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420df7b00 exit status 1 <nil> <nil> true [0xc42032a648 0xc42032a660 0xc42032a678] [0xc42032a648 0xc42032a660 0xc42032a678] [0xc42032a658 0xc42032a670] [0xc37850 0xc37850] 0xc4211a3620 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421a7e200>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.19\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.19\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.19\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.19\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3m1r8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 23:17:07 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 23:17:07 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.19; broadcast_rpc_address=10.180.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3m1r8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 23:17:07 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 23:17:07 Global memtable on-heap threshold is enabled at 128MB\nINFO 23:17:07 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 23:17:07 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.19
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.19
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.19
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.19
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-3m1r8
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 23:17:07 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 23:17:07 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.19; broadcast_rpc_address=10.180.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3m1r8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 23:17:07 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 23:17:07 Global memtable on-heap threshold is enabled at 128MB
INFO 23:17:07 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 23:17:07 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420cd25d0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-19 23:21:50.532 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-nst2q with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 23:21:50.553 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-19 23:21:50.725 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 23:21:50 GMT 2017]; root of context hierarchy\n2017-03-19 23:21:52.796 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-19 23:21:52.818 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 23:21:53.631 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-19 23:21:53.751 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.21]\n2017-03-19 23:21:53.751 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 23:21:53.764 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 23:21:53.800 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.21]:5701\n2017-03-19 23:21:53.800 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 23:21:53.800 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 23:21:54.163 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.21]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 23:21:55.073 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 23:21:55.415 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 23:21:55.420 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 23:21:55.429 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTING\n2017-03-19 23:21:55.433 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 23:21:55.494 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.21]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.21]:5701 - 04ee42b4-60eb-4709-947e-03f180dbf7f8 this\n}\n\n2017-03-19 23:21:55.607 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTED\n2017-03-19 23:21:55.610 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 6.28 seconds (JVM running for 7.266)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-19 23:21:50.532 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-nst2q with PID 5 (/bootstrapper.jar started by root in /)
2017-03-19 23:21:50.553 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-19 23:21:50.725 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 23:21:50 GMT 2017]; root of context hierarchy
2017-03-19 23:21:52.796 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-19 23:21:52.818 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-19 23:21:53.631 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-19 23:21:53.751 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.21]
2017-03-19 23:21:53.751 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-19 23:21:53.764 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-19 23:21:53.800 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.21]:5701
2017-03-19 23:21:53.800 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-19 23:21:53.800 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-19 23:21:54.163 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.21]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-19 23:21:55.073 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-19 23:21:55.415 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-19 23:21:55.420 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-19 23:21:55.429 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTING
2017-03-19 23:21:55.433 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-19 23:21:55.494 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.21]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.21]:5701 - 04ee42b4-60eb-4709-947e-03f180dbf7f8 this
}
2017-03-19 23:21:55.607 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTED
2017-03-19 23:21:55.610 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 6.28 seconds (JVM running for 7.266)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4287/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420ef4130>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-19zhj\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 01:24:10 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 01:24:10 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-19zhj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 01:24:10 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 01:24:10 Global memtable on-heap threshold is enabled at 128MB\nINFO 01:24:10 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:24:10 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.10
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-19zhj
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 01:24:10 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 01:24:10 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-19zhj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 01:24:10 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 01:24:10 Global memtable on-heap threshold is enabled at 128MB
INFO 01:24:10 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 01:24:10 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420cd6230>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 01:28:48.745 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-cxmp5 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 01:28:48.771 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 01:28:48.927 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@69663380: startup date [Mon Mar 20 01:28:48 GMT 2017]; root of context hierarchy\n2017-03-20 01:28:50.607 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 01:28:50.634 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 01:28:51.332 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 01:28:51.445 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.16]\n2017-03-20 01:28:51.446 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 01:28:51.459 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 01:28:51.492 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.16]:5701\n2017-03-20 01:28:51.493 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 01:28:51.493 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 01:28:51.804 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 01:28:52.645 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 01:28:52.987 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 01:28:52.993 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 01:28:53.002 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTING\n2017-03-20 01:28:53.007 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 01:28:53.030 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.16]:5701 - d74ab6e8-1192-4231-97a5-866bfe4405e7 this\n}\n\n2017-03-20 01:28:53.116 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTED\n2017-03-20 01:28:53.118 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.458 seconds (JVM running for 6.6)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 01:28:48.745 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-cxmp5 with PID 5 (/bootstrapper.jar started by root in /)
2017-03-20 01:28:48.771 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 01:28:48.927 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@69663380: startup date [Mon Mar 20 01:28:48 GMT 2017]; root of context hierarchy
2017-03-20 01:28:50.607 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 01:28:50.634 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 01:28:51.332 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 01:28:51.445 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.16]
2017-03-20 01:28:51.446 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 01:28:51.459 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 01:28:51.492 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.16]:5701
2017-03-20 01:28:51.493 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 01:28:51.493 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 01:28:51.804 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 01:28:52.645 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 01:28:52.987 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 01:28:52.993 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 01:28:53.002 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTING
2017-03-20 01:28:53.007 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 01:28:53.030 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.16]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.16]:5701 - d74ab6e8-1192-4231-97a5-866bfe4405e7 this
}
2017-03-20 01:28:53.116 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTED
2017-03-20 01:28:53.118 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.458 seconds (JVM running for 6.6)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.180.50 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8nlkg] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42204f8c0 exit status 1 <nil> <nil> true [0xc420531478 0xc420531490 0xc4205314b0] [0xc420531478 0xc420531490 0xc4205314b0] [0xc420531488 0xc4205314a0] [0xc37850 0xc37850] 0xc4214b9f80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.180.50 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8nlkg] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42204f8c0 exit status 1 <nil> <nil> true [0xc420531478 0xc420531490 0xc4205314b0] [0xc420531478 0xc420531490 0xc4205314b0] [0xc420531488 0xc4205314a0] [0xc37850 0xc37850] 0xc4214b9f80 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4288/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc42214fda0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 02:38:01.926 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-qlmtq with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 02:38:01.950 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 02:38:02.050 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 02:38:02 GMT 2017]; root of context hierarchy\n2017-03-20 02:38:03.619 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 02:38:03.650 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 02:38:04.224 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 02:38:04.358 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.18]\n2017-03-20 02:38:04.358 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 02:38:04.370 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 02:38:04.420 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.18]:5701\n2017-03-20 02:38:04.420 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 02:38:04.420 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 02:38:04.771 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 02:38:05.707 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.2.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 02:38:05.998 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 02:38:06.001 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 02:38:06.016 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.18]:5701 [someGroup] [3.7.5] [10.180.2.18]:5701 is STARTING\n2017-03-20 02:38:06.021 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 02:38:06.070 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.18]:5701 - 94f7f5e8-2c04-4198-85b7-facb260dc1b7 this\n}\n\n2017-03-20 02:38:06.166 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.18]:5701 [someGroup] [3.7.5] [10.180.2.18]:5701 is STARTED\n2017-03-20 02:38:06.181 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.209 seconds (JVM running for 6.158)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 02:38:01.926 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-qlmtq with PID 5 (/bootstrapper.jar started by root in /)
2017-03-20 02:38:01.950 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 02:38:02.050 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 02:38:02 GMT 2017]; root of context hierarchy
2017-03-20 02:38:03.619 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 02:38:03.650 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 02:38:04.224 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 02:38:04.358 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.18]
2017-03-20 02:38:04.358 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 02:38:04.370 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 02:38:04.420 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.18]:5701
2017-03-20 02:38:04.420 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 02:38:04.420 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 02:38:04.771 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 02:38:05.707 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.2.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 02:38:05.998 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 02:38:06.001 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 02:38:06.016 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.18]:5701 [someGroup] [3.7.5] [10.180.2.18]:5701 is STARTING
2017-03-20 02:38:06.021 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 02:38:06.070 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.18]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.18]:5701 - 94f7f5e8-2c04-4198-85b7-facb260dc1b7 this
}
2017-03-20 02:38:06.166 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.18]:5701 [someGroup] [3.7.5] [10.180.2.18]:5701 is STARTED
2017-03-20 02:38:06.181 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.209 seconds (JVM running for 6.158)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.203.146 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8xqr1] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e636b0 exit status 1 <nil> <nil> true [0xc420038320 0xc420038338 0xc420038358] [0xc420038320 0xc420038338 0xc420038358] [0xc420038330 0xc420038348] [0xc37850 0xc37850] 0xc420a58f00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.203.146 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8xqr1] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420e636b0 exit status 1 <nil> <nil> true [0xc420038320 0xc420038338 0xc420038358] [0xc420038320 0xc420038338 0xc420038358] [0xc420038330 0xc420038348] [0xc37850 0xc37850] 0xc420a58f00 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc42120e620>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-ktdt8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 02:32:24 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 02:32:25 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ktdt8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 02:32:25 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 02:32:25 Global memtable on-heap threshold is enabled at 128MB\nINFO 02:32:25 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 02:32:25 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.15
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.15
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.15
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-ktdt8
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 02:32:24 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 02:32:25 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ktdt8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 02:32:25 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 02:32:25 Global memtable on-heap threshold is enabled at 128MB
INFO 02:32:25 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 02:32:25 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4290/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420ec5470>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-dzsq8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 04:26:30 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 04:26:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dzsq8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 04:26:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 04:26:30 Global memtable on-heap threshold is enabled at 128MB\nINFO 04:26:30 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 04:26:30 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.7
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.7
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.7
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-dzsq8
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 04:26:30 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 04:26:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dzsq8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 04:26:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 04:26:30 Global memtable on-heap threshold is enabled at 128MB
INFO 04:26:30 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 04:26:30 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l93fc] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421f96600 exit status 1 <nil> <nil> true [0xc420b122f8 0xc420b12360 0xc420b12380] [0xc420b122f8 0xc420b12360 0xc420b12380] [0xc420b12340 0xc420b12378] [0xc37850 0xc37850] 0xc420839f20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l93fc] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc421f96600 exit status 1 <nil> <nil> true [0xc420b122f8 0xc420b12360 0xc420b12380] [0xc420b122f8 0xc420b12360 0xc420b12380] [0xc420b12340 0xc420b12378] [0xc37850 0xc37850] 0xc420839f20 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc422032830>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 04:43:55.529 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-05b2n with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 04:43:55.544 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 04:43:55.630 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 04:43:55 GMT 2017]; root of context hierarchy\n2017-03-20 04:43:57.398 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 04:43:57.443 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 04:43:58.144 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 04:43:58.281 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.21]\n2017-03-20 04:43:58.282 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 04:43:58.296 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 04:43:58.330 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.21]:5701\n2017-03-20 04:43:58.331 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 04:43:58.331 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 04:43:58.653 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.21]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 04:43:59.506 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 04:43:59.815 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 04:43:59.823 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 04:43:59.832 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTING\n2017-03-20 04:43:59.834 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 04:43:59.856 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.21]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.21]:5701 - 74ffc379-4632-4632-a086-c3fbcc63db50 this\n}\n\n2017-03-20 04:43:59.924 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTED\n2017-03-20 04:43:59.935 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.451 seconds (JVM running for 6.435)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 04:43:55.529 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-05b2n with PID 5 (/bootstrapper.jar started by root in /)
2017-03-20 04:43:55.544 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 04:43:55.630 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 04:43:55 GMT 2017]; root of context hierarchy
2017-03-20 04:43:57.398 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 04:43:57.443 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 04:43:58.144 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 04:43:58.281 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.21]
2017-03-20 04:43:58.282 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 04:43:58.296 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 04:43:58.330 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.21]:5701
2017-03-20 04:43:58.331 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 04:43:58.331 INFO 5 --- [ main] com.hazelcast.system : [10.180.1.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 04:43:58.653 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.21]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 04:43:59.506 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.1.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 04:43:59.815 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 04:43:59.823 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 04:43:59.832 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTING
2017-03-20 04:43:59.834 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 04:43:59.856 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.21]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.21]:5701 - 74ffc379-4632-4632-a086-c3fbcc63db50 this
}
2017-03-20 04:43:59.924 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTED
2017-03-20 04:43:59.935 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.451 seconds (JVM running for 6.435)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4291/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc42120e080>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-34mgv\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 05:41:20 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 05:41:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-34mgv}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 05:41:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 05:41:20 Global memtable on-heap threshold is enabled at 128MB\nINFO 05:41:20 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:41:21 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.11
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.11
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.11
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-34mgv
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 05:41:20 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 05:41:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-34mgv}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 05:41:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 05:41:20 Global memtable on-heap threshold is enabled at 128MB
INFO 05:41:20 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 05:41:21 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc42109d0c0>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 05:46:28.921 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-ld1l3 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 05:46:28.929 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 05:46:29.031 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 05:46:29 GMT 2017]; root of context hierarchy\n2017-03-20 05:46:30.961 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 05:46:30.988 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 05:46:31.724 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 05:46:31.854 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.13]\n2017-03-20 05:46:31.855 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 05:46:31.868 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 05:46:31.901 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.13]:5701\n2017-03-20 05:46:31.901 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 05:46:31.901 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 05:46:32.252 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 05:46:33.250 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 05:46:33.526 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 05:46:33.528 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 05:46:33.544 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTING\n2017-03-20 05:46:33.548 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 05:46:33.586 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.13]:5701 - 65221253-6ee1-453e-bbf8-1ae06b8252b8 this\n}\n\n2017-03-20 05:46:33.665 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTED\n2017-03-20 05:46:33.670 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.78 seconds (JVM running for 6.703)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 05:46:28.921 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-ld1l3 with PID 6 (/bootstrapper.jar started by root in /)
2017-03-20 05:46:28.929 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 05:46:29.031 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 05:46:29 GMT 2017]; root of context hierarchy
2017-03-20 05:46:30.961 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 05:46:30.988 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 05:46:31.724 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 05:46:31.854 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.13]
2017-03-20 05:46:31.855 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 05:46:31.868 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 05:46:31.901 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.13]:5701
2017-03-20 05:46:31.901 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 05:46:31.901 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 05:46:32.252 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 05:46:33.250 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 05:46:33.526 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 05:46:33.528 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 05:46:33.544 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTING
2017-03-20 05:46:33.548 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 05:46:33.586 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.13]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.13]:5701 - 65221253-6ee1-453e-bbf8-1ae06b8252b8 this
}
2017-03-20 05:46:33.665 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTED
2017-03-20 05:46:33.670 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.78 seconds (JVM running for 6.703)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0g72b] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420d4f200 exit status 1 <nil> <nil> true [0xc420e52ba8 0xc420e52bd8 0xc420e52bf0] [0xc420e52ba8 0xc420e52bd8 0xc420e52bf0] [0xc420e52bd0 0xc420e52be8] [0xc37850 0xc37850] 0xc421cbbc80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0g72b] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420d4f200 exit status 1 <nil> <nil> true [0xc420e52ba8 0xc420e52bd8 0xc420e52bf0] [0xc420e52ba8 0xc420e52bd8 0xc420e52bf0] [0xc420e52bd0 0xc420e52be8] [0xc37850 0xc37850] 0xc421cbbc80 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4292/ Multiple broken tests:
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421202280>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-gkp3f\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 06:41:08 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 06:41:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gkp3f}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 06:41:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 06:41:09 Global memtable on-heap threshold is enabled at 128MB\nINFO 06:41:09 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:41:09 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.8
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.8
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.8
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-gkp3f
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 06:41:08 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 06:41:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gkp3f}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 06:41:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 06:41:09 Global memtable on-heap threshold is enabled at 128MB
INFO 06:41:09 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 06:41:09 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.172.103 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v2l5n] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e07890 exit status 1 <nil> <nil> true [0xc420036620 0xc420036648 0xc420036668] [0xc420036620 0xc420036648 0xc420036668] [0xc420036638 0xc420036660] [0xc37850 0xc37850] 0xc4213cf980 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.172.103 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v2l5n] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420e07890 exit status 1 <nil> <nil> true [0xc420036620 0xc420036648 0xc420036668] [0xc420036620 0xc420036648 0xc420036668] [0xc420036638 0xc420036660] [0xc37850 0xc37850] 0xc4213cf980 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4221dea60>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 06:51:44.822 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-s0k2z with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-20 06:51:44.831 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 06:51:44.970 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 06:51:44 GMT 2017]; root of context hierarchy\n2017-03-20 06:51:46.730 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 06:51:46.755 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 06:51:47.422 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 06:51:47.562 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.27]\n2017-03-20 06:51:47.562 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 06:51:47.575 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.27]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 06:51:47.611 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.27]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.27]:5701\n2017-03-20 06:51:47.611 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.27]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 06:51:47.611 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.27]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 06:51:47.989 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.27]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 06:51:48.879 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.1.27]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 06:51:49.170 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.27]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 06:51:49.178 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.27]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 06:51:49.188 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.27]:5701 [someGroup] [3.7.5] [10.180.1.27]:5701 is STARTING\n2017-03-20 06:51:49.191 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.27]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 06:51:49.215 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.27]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.27]:5701 - a9e94fb0-0804-4737-8d68-e04b9e3dc5f8 this\n}\n\n2017-03-20 06:51:49.286 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.27]:5701 [someGroup] [3.7.5] [10.180.1.27]:5701 is STARTED\n2017-03-20 06:51:49.298 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.511 seconds (JVM running for 6.554)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 06:51:44.822 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-s0k2z with PID 7 (/bootstrapper.jar started by root in /)
2017-03-20 06:51:44.831 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 06:51:44.970 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 06:51:44 GMT 2017]; root of context hierarchy
2017-03-20 06:51:46.730 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 06:51:46.755 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 06:51:47.422 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 06:51:47.562 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.27]
2017-03-20 06:51:47.562 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 06:51:47.575 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.27]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 06:51:47.611 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.27]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.27]:5701
2017-03-20 06:51:47.611 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.27]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 06:51:47.611 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.27]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 06:51:47.989 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.27]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 06:51:48.879 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.1.27]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 06:51:49.170 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.27]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 06:51:49.178 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.27]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 06:51:49.188 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.27]:5701 [someGroup] [3.7.5] [10.180.1.27]:5701 is STARTING
2017-03-20 06:51:49.191 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.27]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 06:51:49.215 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.27]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.27]:5701 - a9e94fb0-0804-4737-8d68-e04b9e3dc5f8 this
}
2017-03-20 06:51:49.286 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.27]:5701 [someGroup] [3.7.5] [10.180.1.27]:5701 is STARTED
2017-03-20 06:51:49.298 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.511 seconds (JVM running for 6.554)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4293/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421c82650>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3pq58\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 07:38:52 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 07:38:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3pq58}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 07:38:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 07:38:52 Global memtable on-heap threshold is enabled at 128MB\nINFO 07:38:52 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 07:38:53 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.10
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-3pq58
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 07:38:52 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 07:38:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3pq58}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 07:38:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 07:38:52 Global memtable on-heap threshold is enabled at 128MB
INFO 07:38:52 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 07:38:53 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
<*errors.errorString | 0xc4203fc790>: {
s: "timed out waiting for the condition",
}
timed out waiting for the condition
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:145
Issues about this test specifically: #36279
Failed: [k8s.io] [Feature:Example] [k8s.io] Downward API should create a pod that prints his name and namespace {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:120
Mar 20 01:12:53.802: All nodes should be ready after test, Not ready nodes: ", bootstrap-e2e-minion-group-h671"
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:335
Issues about this test specifically: #31539 #31888 #35261
Failed: [k8s.io] [Feature:Example] [k8s.io] Storm should create and stop Zookeeper, Nimbus and Storm worker servers {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:120
Mar 20 01:18:28.250: All nodes should be ready after test, Not ready nodes: ", bootstrap-e2e-minion-group-h671"
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:335
Issues about this test specifically: #29225 #33106 #38047
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420d34c40>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 08:19:05.984 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-dkbqz with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 08:19:05.991 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 08:19:06.127 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 08:19:06 GMT 2017]; root of context hierarchy\n2017-03-20 08:19:08.031 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 08:19:08.051 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 08:19:08.809 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 08:19:08.916 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]\n2017-03-20 08:19:08.917 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 08:19:08.928 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 08:19:08.961 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701\n2017-03-20 08:19:08.961 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 08:19:08.961 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 08:19:09.310 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 08:19:10.228 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 08:19:10.527 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 08:19:10.534 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 08:19:10.542 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING\n2017-03-20 08:19:10.553 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 08:19:10.596 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.17]:5701 - adad1f87-1828-417c-8c41-2f85272eb2a7 this\n}\n\n2017-03-20 08:19:10.661 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED\n2017-03-20 08:19:10.670 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.743 seconds (JVM running for 6.572)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 08:19:05.984 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-dkbqz with PID 6 (/bootstrapper.jar started by root in /)
2017-03-20 08:19:05.991 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 08:19:06.127 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 08:19:06 GMT 2017]; root of context hierarchy
2017-03-20 08:19:08.031 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 08:19:08.051 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 08:19:08.809 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 08:19:08.916 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]
2017-03-20 08:19:08.917 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 08:19:08.928 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 08:19:08.961 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701
2017-03-20 08:19:08.961 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 08:19:08.961 INFO 6 --- [ main] com.hazelcast.system : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 08:19:09.310 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 08:19:10.228 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 08:19:10.527 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 08:19:10.534 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 08:19:10.542 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING
2017-03-20 08:19:10.553 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 08:19:10.596 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.17]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.17]:5701 - adad1f87-1828-417c-8c41-2f85272eb2a7 this
}
2017-03-20 08:19:10.661 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED
2017-03-20 08:19:10.670 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.743 seconds (JVM running for 6.572)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.172.103 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tgzd1] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420dd7d40 exit status 1 <nil> <nil> true [0xc420038738 0xc420038750 0xc420038768] [0xc420038738 0xc420038750 0xc420038768] [0xc420038748 0xc420038760] [0xc37850 0xc37850] 0xc421129e00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.172.103 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tgzd1] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420dd7d40 exit status 1 <nil> <nil> true [0xc420038738 0xc420038750 0xc420038768] [0xc420038738 0xc420038750 0xc420038768] [0xc420038748 0xc420038760] [0xc37850 0xc37850] 0xc421129e00 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4294/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420c3cbf0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-73g33\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 09:15:51 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 09:15:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-73g33}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 09:15:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 09:15:52 Global memtable on-heap threshold is enabled at 128MB\nINFO 09:15:52 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:15:52 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.11
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.11
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.11
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-73g33
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 09:15:51 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 09:15:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-73g33}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 09:15:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 09:15:52 Global memtable on-heap threshold is enabled at 128MB
INFO 09:15:52 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 09:15:52 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7wwb9] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4215ac510 exit status 1 <nil> <nil> true [0xc420212bb0 0xc420212bf8 0xc420212c40] [0xc420212bb0 0xc420212bf8 0xc420212c40] [0xc420212bf0 0xc420212c20] [0xc37850 0xc37850] 0xc421575e60 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7wwb9] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4215ac510 exit status 1 <nil> <nil> true [0xc420212bb0 0xc420212bf8 0xc420212c40] [0xc420212bb0 0xc420212bf8 0xc420212c40] [0xc420212bf0 0xc420212c20] [0xc37850 0xc37850] 0xc421575e60 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc422027380>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 09:27:10.397 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-vvlv4 with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-20 09:27:10.405 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 09:27:10.544 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 09:27:10 GMT 2017]; root of context hierarchy\n2017-03-20 09:27:12.171 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 09:27:12.198 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 09:27:12.933 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 09:27:13.051 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-20 09:27:13.052 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 09:27:13.065 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 09:27:13.096 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-20 09:27:13.096 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 09:27:13.097 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 09:27:13.496 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 09:27:14.517 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 09:27:14.797 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 09:27:14.802 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 09:27:14.810 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-20 09:27:14.811 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 09:27:14.848 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - 5c3c1488-da90-424b-aa9b-cfad2ed80326 this\n}\n\n2017-03-20 09:27:14.930 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-20 09:27:14.938 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.594 seconds (JVM running for 6.475)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 09:27:10.397 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-vvlv4 with PID 7 (/bootstrapper.jar started by root in /)
2017-03-20 09:27:10.405 INFO 7 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 09:27:10.544 INFO 7 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 09:27:10 GMT 2017]; root of context hierarchy
2017-03-20 09:27:12.171 INFO 7 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 09:27:12.198 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 09:27:12.933 INFO 7 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 09:27:13.051 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
2017-03-20 09:27:13.052 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 09:27:13.065 INFO 7 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 09:27:13.096 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
2017-03-20 09:27:13.096 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 09:27:13.097 INFO 7 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 09:27:13.496 INFO 7 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 09:27:14.517 INFO 7 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 09:27:14.797 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 09:27:14.802 INFO 7 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 09:27:14.810 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
2017-03-20 09:27:14.811 INFO 7 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 09:27:14.848 INFO 7 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.16]:5701 - 5c3c1488-da90-424b-aa9b-cfad2ed80326 this
}
2017-03-20 09:27:14.930 INFO 7 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
2017-03-20 09:27:14.938 INFO 7 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.594 seconds (JVM running for 6.475)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4295/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-z7prq] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420deb7d0 exit status 1 <nil> <nil> true [0xc420598b48 0xc420598b60 0xc420598b78] [0xc420598b48 0xc420598b60 0xc420598b78] [0xc420598b58 0xc420598b70] [0xc37850 0xc37850] 0xc421338ba0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-z7prq] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420deb7d0 exit status 1 <nil> <nil> true [0xc420598b48 0xc420598b60 0xc420598b78] [0xc420598b48 0xc420598b60 0xc420598b78] [0xc420598b58 0xc420598b70] [0xc37850 0xc37850] 0xc421338ba0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420bce460>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 10:14:44.321 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-kn5gw with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 10:14:44.327 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 10:14:44.415 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 10:14:44 GMT 2017]; root of context hierarchy\n2017-03-20 10:14:45.912 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 10:14:45.927 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 10:14:46.434 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 10:14:46.527 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-20 10:14:46.527 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 10:14:46.538 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 10:14:46.564 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-20 10:14:46.564 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 10:14:46.564 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 10:14:46.852 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 10:14:47.664 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 10:14:47.907 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 10:14:47.917 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 10:14:47.930 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-20 10:14:47.931 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 10:14:47.955 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - ecebabe7-5fc0-42d1-bc64-02f3073e6d42 this\n}\n\n2017-03-20 10:14:48.015 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-20 10:14:48.017 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 4.513 seconds (JVM running for 5.269)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 10:14:44.321 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-kn5gw with PID 6 (/bootstrapper.jar started by root in /)
2017-03-20 10:14:44.327 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 10:14:44.415 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 10:14:44 GMT 2017]; root of context hierarchy
2017-03-20 10:14:45.912 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 10:14:45.927 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 10:14:46.434 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 10:14:46.527 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
2017-03-20 10:14:46.527 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 10:14:46.538 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 10:14:46.564 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
2017-03-20 10:14:46.564 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 10:14:46.564 INFO 6 --- [ main] com.hazelcast.system : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 10:14:46.852 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 10:14:47.664 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 10:14:47.907 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 10:14:47.917 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 10:14:47.930 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
2017-03-20 10:14:47.931 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 10:14:47.955 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.1.16]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.1.16]:5701 - ecebabe7-5fc0-42d1-bc64-02f3073e6d42 this
}
2017-03-20 10:14:48.015 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
2017-03-20 10:14:48.017 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 4.513 seconds (JVM running for 5.269)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc4205a7510>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-25gj6\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 10:34:22 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 10:34:22 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-25gj6}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 10:34:22 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 10:34:23 Global memtable on-heap threshold is enabled at 128MB\nINFO 10:34:23 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 10:34:23 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.14
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-25gj6
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 10:34:22 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 10:34:22 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-25gj6}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 10:34:22 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 10:34:23 Global memtable on-heap threshold is enabled at 128MB
INFO 10:34:23 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 10:34:23 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4296/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc42126b770>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 11:08:58.803 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-w2q8s with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 11:08:58.813 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 11:08:58.893 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 11:08:58 GMT 2017]; root of context hierarchy\n2017-03-20 11:09:00.378 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 11:09:00.395 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 11:09:00.945 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 11:09:01.048 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.4]\n2017-03-20 11:09:01.048 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 11:09:01.060 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 11:09:01.089 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.4]:5701\n2017-03-20 11:09:01.089 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 11:09:01.089 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 11:09:01.450 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.4]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 11:09:02.301 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 11:09:02.567 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 11:09:02.575 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 11:09:02.597 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTING\n2017-03-20 11:09:02.603 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 11:09:02.627 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.4]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.4]:5701 - 6b8c96ab-d1a4-4578-b167-12921d994a46 this\n}\n\n2017-03-20 11:09:02.693 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTED\n2017-03-20 11:09:02.699 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 4.797 seconds (JVM running for 5.571)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 11:08:58.803 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-w2q8s with PID 5 (/bootstrapper.jar started by root in /)
2017-03-20 11:08:58.813 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 11:08:58.893 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 11:08:58 GMT 2017]; root of context hierarchy
2017-03-20 11:09:00.378 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 11:09:00.395 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 11:09:00.945 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 11:09:01.048 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.4]
2017-03-20 11:09:01.048 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 11:09:01.060 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 11:09:01.089 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.4]:5701
2017-03-20 11:09:01.089 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 11:09:01.089 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 11:09:01.450 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.4]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 11:09:02.301 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 11:09:02.567 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 11:09:02.575 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 11:09:02.597 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTING
2017-03-20 11:09:02.603 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 11:09:02.627 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.4]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.4]:5701 - 6b8c96ab-d1a4-4578-b167-12921d994a46 this
}
2017-03-20 11:09:02.693 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTED
2017-03-20 11:09:02.699 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 4.797 seconds (JVM running for 5.571)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421ed2280>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.5\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.5\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.5\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.5\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-06l5k\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 11:23:49 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 11:23:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.5; broadcast_rpc_address=10.180.3.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-06l5k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 11:23:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 11:23:50 Global memtable on-heap threshold is enabled at 128MB\nINFO 11:23:50 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:23:50 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.5
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.5
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.5
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.5
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-06l5k
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 11:23:49 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 11:23:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.5; broadcast_rpc_address=10.180.3.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-06l5k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 11:23:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 11:23:50 Global memtable on-heap threshold is enabled at 128MB
INFO 11:23:50 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 11:23:50 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-szbhx] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4209ef890 exit status 1 <nil> <nil> true [0xc4201c4348 0xc4201c4378 0xc4201c43d0] [0xc4201c4348 0xc4201c4378 0xc4201c43d0] [0xc4201c4368 0xc4201c43b0] [0xc37850 0xc37850] 0xc420bb85a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-szbhx] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4209ef890 exit status 1 <nil> <nil> true [0xc4201c4348 0xc4201c4378 0xc4201c43d0] [0xc4201c4348 0xc4201c4378 0xc4201c43d0] [0xc4201c4368 0xc4201c43b0] [0xc37850 0xc37850] 0xc420bb85a0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4297/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc4212ea410>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 12:13:34.051 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-ht2mq with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 12:13:34.071 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 12:13:34.147 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 12:13:34 GMT 2017]; root of context hierarchy\n2017-03-20 12:13:35.945 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 12:13:35.968 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 12:13:36.598 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 12:13:36.706 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]\n2017-03-20 12:13:36.706 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 12:13:36.717 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 12:13:36.747 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-20 12:13:36.747 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 12:13:36.747 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 12:13:37.089 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 12:13:37.939 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 12:13:38.204 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 12:13:38.205 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 12:13:38.224 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-20 12:13:38.226 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 12:13:38.277 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 38f8e5f6-313a-4b87-9b80-94980208a283 this\n}\n\n2017-03-20 12:13:38.346 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-20 12:13:38.350 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.304 seconds (JVM running for 6.141)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 12:13:34.051 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-ht2mq with PID 6 (/bootstrapper.jar started by root in /)
2017-03-20 12:13:34.071 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 12:13:34.147 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 12:13:34 GMT 2017]; root of context hierarchy
2017-03-20 12:13:35.945 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 12:13:35.968 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 12:13:36.598 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 12:13:36.706 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]
2017-03-20 12:13:36.706 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 12:13:36.717 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 12:13:36.747 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
2017-03-20 12:13:36.747 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 12:13:36.747 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 12:13:37.089 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 12:13:37.939 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 12:13:38.204 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 12:13:38.205 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 12:13:38.224 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
2017-03-20 12:13:38.226 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 12:13:38.277 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.6]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.6]:5701 - 38f8e5f6-313a-4b87-9b80-94980208a283 this
}
2017-03-20 12:13:38.346 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
2017-03-20 12:13:38.350 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.304 seconds (JVM running for 6.141)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.26.222 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8v9xd] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421b64f30 exit status 1 <nil> <nil> true [0xc420038990 0xc4200389d8 0xc420038a10] [0xc420038990 0xc4200389d8 0xc420038a10] [0xc4200389a8 0xc420038a08] [0xc37850 0xc37850] 0xc420c5d0e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.26.222 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8v9xd] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc421b64f30 exit status 1 <nil> <nil> true [0xc420038990 0xc4200389d8 0xc420038a10] [0xc420038990 0xc4200389d8 0xc420038a10] [0xc4200389a8 0xc420038a08] [0xc37850 0xc37850] 0xc420c5d0e0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421fe0470>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-ts1nz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 12:40:58 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 12:40:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ts1nz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 12:40:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 12:40:59 Global memtable on-heap threshold is enabled at 128MB\nINFO 12:40:59 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 12:40:59 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.14
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.14
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.14
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-ts1nz
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 12:40:58 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 12:40:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ts1nz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 12:40:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 12:40:59 Global memtable on-heap threshold is enabled at 128MB
INFO 12:40:59 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 12:40:59 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4298/ Multiple broken tests:
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420c9ca40>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 13:19:34.787 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-ftm23 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 13:19:34.794 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 13:19:34.896 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 13:19:34 GMT 2017]; root of context hierarchy\n2017-03-20 13:19:36.558 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 13:19:36.584 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 13:19:37.185 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 13:19:37.309 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.10]\n2017-03-20 13:19:37.309 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 13:19:37.323 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 13:19:37.356 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.10]:5701\n2017-03-20 13:19:37.357 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 13:19:37.357 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 13:19:37.759 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.10]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 13:19:38.688 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.2.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 13:19:38.948 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 13:19:38.950 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 13:19:38.964 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTING\n2017-03-20 13:19:38.966 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 13:19:39.030 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.10]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.10]:5701 - cad14c04-6072-4823-ae4f-73413133a298 this\n}\n\n2017-03-20 13:19:39.105 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTED\n2017-03-20 13:19:39.109 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.291 seconds (JVM running for 6.18)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 13:19:34.787 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-ftm23 with PID 5 (/bootstrapper.jar started by root in /)
2017-03-20 13:19:34.794 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 13:19:34.896 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 13:19:34 GMT 2017]; root of context hierarchy
2017-03-20 13:19:36.558 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 13:19:36.584 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 13:19:37.185 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 13:19:37.309 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.10]
2017-03-20 13:19:37.309 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 13:19:37.323 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 13:19:37.356 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.10]:5701
2017-03-20 13:19:37.357 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 13:19:37.357 INFO 5 --- [ main] com.hazelcast.system : [10.180.2.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 13:19:37.759 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.2.10]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 13:19:38.688 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.2.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 13:19:38.948 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 13:19:38.950 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 13:19:38.964 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTING
2017-03-20 13:19:38.966 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.2.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 13:19:39.030 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.2.10]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.2.10]:5701 - cad14c04-6072-4823-ae4f-73413133a298 this
}
2017-03-20 13:19:39.105 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTED
2017-03-20 13:19:39.109 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.291 seconds (JVM running for 6.18)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tqsjr] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421851fb0 exit status 1 <nil> <nil> true [0xc420036708 0xc420036750 0xc420036770] [0xc420036708 0xc420036750 0xc420036770] [0xc420036738 0xc420036768] [0xc37850 0xc37850] 0xc4218031a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tqsjr] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc421851fb0 exit status 1 <nil> <nil> true [0xc420036708 0xc420036750 0xc420036770] [0xc420036708 0xc420036750 0xc420036770] [0xc420036738 0xc420036768] [0xc37850 0xc37850] 0xc4218031a0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc4210e7a70>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-56pg0\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 13:43:53 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 13:43:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.13; broadcast_rpc_address=10.180.3.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-56pg0}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 13:43:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 13:43:53 Global memtable on-heap threshold is enabled at 128MB\nINFO 13:43:53 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:43:53 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.13
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.13
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.13
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.13
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-56pg0
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 13:43:53 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 13:43:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.13; broadcast_rpc_address=10.180.3.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-56pg0}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 13:43:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 13:43:53 Global memtable on-heap threshold is enabled at 128MB
INFO 13:43:53 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 13:43:53 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4299/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420c9e360>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 14:39:20.310 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-llr94 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 14:39:20.319 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 14:39:20.452 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 14:39:20 GMT 2017]; root of context hierarchy\n2017-03-20 14:39:22.275 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 14:39:22.299 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 14:39:22.964 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 14:39:23.091 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-20 14:39:23.092 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 14:39:23.104 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 14:39:23.134 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-20 14:39:23.134 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 14:39:23.135 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 14:39:23.453 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 14:39:24.360 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 14:39:24.636 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 14:39:24.648 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 14:39:24.673 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-20 14:39:24.676 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 14:39:24.710 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - 31ced6bc-ae70-4242-8a2a-78577d9ffce7 this\n}\n\n2017-03-20 14:39:24.775 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-20 14:39:24.789 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.452 seconds (JVM running for 6.322)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 14:39:20.310 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-llr94 with PID 6 (/bootstrapper.jar started by root in /)
2017-03-20 14:39:20.319 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 14:39:20.452 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 14:39:20 GMT 2017]; root of context hierarchy
2017-03-20 14:39:22.275 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 14:39:22.299 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 14:39:22.964 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 14:39:23.091 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
2017-03-20 14:39:23.092 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 14:39:23.104 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 14:39:23.134 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
2017-03-20 14:39:23.134 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 14:39:23.135 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 14:39:23.453 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 14:39:24.360 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 14:39:24.636 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 14:39:24.648 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 14:39:24.673 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
2017-03-20 14:39:24.676 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 14:39:24.710 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.18]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.18]:5701 - 31ced6bc-ae70-4242-8a2a-78577d9ffce7 this
}
2017-03-20 14:39:24.775 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
2017-03-20 14:39:24.789 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.452 seconds (JVM running for 6.322)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.122.106 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pjl65] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421557740 exit status 1 <nil> <nil> true [0xc420484a60 0xc420484a90 0xc420484ae8] [0xc420484a60 0xc420484a90 0xc420484ae8] [0xc420484a78 0xc420484ab8] [0xc37db0 0xc37db0] 0xc4216caae0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.122.106 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pjl65] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc421557740 exit status 1 <nil> <nil> true [0xc420484a60 0xc420484a90 0xc420484ae8] [0xc420484a60 0xc420484a90 0xc420484ae8] [0xc420484a78 0xc420484ab8] [0xc37db0 0xc37db0] 0xc4216caae0 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420800260>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0qt5w\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 14:36:39 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 14:36:39 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0qt5w}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 14:36:39 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 14:36:39 Global memtable on-heap threshold is enabled at 128MB\nINFO 14:36:39 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:36:39 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.14
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.14
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.14
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-0qt5w
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 14:36:39 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 14:36:39 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0qt5w}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 14:36:39 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 14:36:39 Global memtable on-heap threshold is enabled at 128MB
INFO 14:36:39 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 14:36:39 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4300/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc42078f780>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 15:23:16.860 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-kg44w with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 15:23:16.886 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 15:23:17.043 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 15:23:17 GMT 2017]; root of context hierarchy\n2017-03-20 15:23:18.660 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 15:23:18.682 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 15:23:19.387 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 15:23:19.523 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.4]\n2017-03-20 15:23:19.524 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 15:23:19.537 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 15:23:19.573 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.4]:5701\n2017-03-20 15:23:19.574 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 15:23:19.574 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 15:23:20.046 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.4]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 15:23:20.956 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 15:23:21.290 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 15:23:21.301 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 15:23:21.316 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTING\n2017-03-20 15:23:21.318 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 15:23:21.368 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.4]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.4]:5701 - 8360cdf1-ad12-4859-a482-c8b58ae7eebe this\n}\n\n2017-03-20 15:23:21.427 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTED\n2017-03-20 15:23:21.435 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.664 seconds (JVM running for 6.596)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 15:23:16.860 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-kg44w with PID 5 (/bootstrapper.jar started by root in /)
2017-03-20 15:23:16.886 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 15:23:17.043 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 15:23:17 GMT 2017]; root of context hierarchy
2017-03-20 15:23:18.660 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 15:23:18.682 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 15:23:19.387 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 15:23:19.523 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.4]
2017-03-20 15:23:19.524 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 15:23:19.537 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 15:23:19.573 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.4]:5701
2017-03-20 15:23:19.574 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 15:23:19.574 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 15:23:20.046 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.4]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 15:23:20.956 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 15:23:21.290 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 15:23:21.301 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 15:23:21.316 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTING
2017-03-20 15:23:21.318 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 15:23:21.368 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.4]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.4]:5701 - 8360cdf1-ad12-4859-a482-c8b58ae7eebe this
}
2017-03-20 15:23:21.427 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTED
2017-03-20 15:23:21.435 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.664 seconds (JVM running for 6.596)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pqvnd] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42126ebd0 exit status 1 <nil> <nil> true [0xc420574c80 0xc420574ce8 0xc420574d28] [0xc420574c80 0xc420574ce8 0xc420574d28] [0xc420574cb8 0xc420574d10] [0xc37db0 0xc37db0] 0xc4211ab620 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pqvnd] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc42126ebd0 exit status 1 <nil> <nil> true [0xc420574c80 0xc420574ce8 0xc420574d28] [0xc420574c80 0xc420574ce8 0xc420574d28] [0xc420574cb8 0xc420574d10] [0xc37db0 0xc37db0] 0xc4211ab620 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc421a90940>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.21\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.21\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.21\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.21\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3f4pg\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 15:51:03 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 15:51:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.21; broadcast_rpc_address=10.180.3.21; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.21; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3f4pg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 15:51:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 15:51:03 Global memtable on-heap threshold is enabled at 128MB\nINFO 15:51:03 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:51:03 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.21
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.3.21
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.21
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.3.21
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-3f4pg
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 15:51:03 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 15:51:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.21; broadcast_rpc_address=10.180.3.21; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.21; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3f4pg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 15:51:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 15:51:03 Global memtable on-heap threshold is enabled at 128MB
INFO 15:51:03 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 15:51:03 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4301/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420dae030>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 16:47:06.641 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-zt1mt with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 16:47:06.649 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 16:47:06.813 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 16:47:06 GMT 2017]; root of context hierarchy\n2017-03-20 16:47:08.473 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 16:47:08.499 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 16:47:09.159 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 16:47:09.300 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-20 16:47:09.301 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 16:47:09.313 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 16:47:09.357 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-20 16:47:09.358 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 16:47:09.358 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 16:47:09.723 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 16:47:10.590 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 16:47:10.915 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 16:47:10.933 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 16:47:10.943 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-20 16:47:10.947 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 16:47:10.981 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - f0e31395-a3b8-45eb-ad00-6b7178b0e955 this\n}\n\n2017-03-20 16:47:11.092 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-20 16:47:11.096 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.552 seconds (JVM running for 6.491)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 16:47:06.641 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-zt1mt with PID 5 (/bootstrapper.jar started by root in /)
2017-03-20 16:47:06.649 INFO 5 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 16:47:06.813 INFO 5 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 16:47:06 GMT 2017]; root of context hierarchy
2017-03-20 16:47:08.473 INFO 5 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 16:47:08.499 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 16:47:09.159 INFO 5 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 16:47:09.300 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
2017-03-20 16:47:09.301 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 16:47:09.313 INFO 5 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 16:47:09.357 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
2017-03-20 16:47:09.358 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 16:47:09.358 INFO 5 --- [ main] com.hazelcast.system : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 16:47:09.723 INFO 5 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 16:47:10.590 INFO 5 --- [ main] com.hazelcast.instance.Node : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 16:47:10.915 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 16:47:10.933 INFO 5 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 16:47:10.943 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
2017-03-20 16:47:10.947 INFO 5 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 16:47:10.981 INFO 5 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.18]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.18]:5701 - f0e31395-a3b8-45eb-ad00-6b7178b0e955 this
}
2017-03-20 16:47:11.092 INFO 5 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
2017-03-20 16:47:11.096 INFO 5 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.552 seconds (JVM running for 6.491)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc420f523d0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.16\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.16\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.16\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.16\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-gc2z2\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 17:02:30 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 17:02:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.16; broadcast_rpc_address=10.180.2.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gc2z2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 17:02:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 17:02:31 Global memtable on-heap threshold is enabled at 128MB\nINFO 17:02:31 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:02:31 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.16
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.2.16
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.16
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.2.16
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-gc2z2
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 17:02:30 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 17:02:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.16; broadcast_rpc_address=10.180.2.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gc2z2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 17:02:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 17:02:31 Global memtable on-heap threshold is enabled at 128MB
INFO 17:02:31 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 17:02:31 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.156.139 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-2k6dm] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4214d9fb0 exit status 1 <nil> <nil> true [0xc4203241c8 0xc4203241f0 0xc420324208] [0xc4203241c8 0xc4203241f0 0xc420324208] [0xc4203241e8 0xc420324200] [0xc37db0 0xc37db0] 0xc42083d260 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.156.139 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-2k6dm] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc4214d9fb0 exit status 1 <nil> <nil> true [0xc4203241c8 0xc4203241f0 0xc420324208] [0xc4203241c8 0xc4203241f0 0xc420324208] [0xc4203241e8 0xc420324200] [0xc37db0 0xc37db0] 0xc42083d260 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4302/ Multiple broken tests:
Failed: Test {e2e.go}
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
<*errors.errorString | 0xc420b3da90>: {
s: "Failed to find \"Members [2]\", last result: \"2017-03-20 17:48:24.543 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-xzs6x with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 17:48:24.550 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default\n2017-03-20 17:48:24.687 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 17:48:24 GMT 2017]; root of context hierarchy\n2017-03-20 17:48:26.440 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup\n2017-03-20 17:48:26.464 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 17:48:27.095 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.\n2017-03-20 17:48:27.238 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-20 17:48:27.239 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 17:48:27.250 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 17:48:27.293 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-20 17:48:27.294 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 17:48:27.294 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 17:48:27.618 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 17:48:28.452 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 17:48:28.716 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 17:48:28.726 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 17:48:28.737 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-20 17:48:28.738 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 17:48:28.769 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - fd46c90d-ff0a-40cf-8a98-afba10f24924 this\n}\n\n2017-03-20 17:48:28.836 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-20 17:48:28.850 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.286 seconds (JVM running for 6.211)\n\"",
}
Failed to find "Members [2]", last result: "2017-03-20 17:48:24.543 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Starting Application on hazelcast-944810110-xzs6x with PID 6 (/bootstrapper.jar started by root in /)
2017-03-20 17:48:24.550 INFO 6 --- [ main] com.github.pires.hazelcast.Application : No active profile set, falling back to default profiles: default
2017-03-20 17:48:24.687 INFO 6 --- [ main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 17:48:24 GMT 2017]; root of context hierarchy
2017-03-20 17:48:26.440 INFO 6 --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2017-03-20 17:48:26.464 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
2017-03-20 17:48:27.095 INFO 6 --- [ main] c.g.p.h.HazelcastDiscoveryController : Found 1 pods running Hazelcast.
2017-03-20 17:48:27.238 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
2017-03-20 17:48:27.239 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
2017-03-20 17:48:27.250 INFO 6 --- [ main] c.h.instance.DefaultAddressPicker : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
2017-03-20 17:48:27.293 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
2017-03-20 17:48:27.294 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
2017-03-20 17:48:27.294 INFO 6 --- [ main] com.hazelcast.system : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
2017-03-20 17:48:27.618 INFO 6 --- [ main] c.h.s.i.o.impl.BackpressureRegulator : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
2017-03-20 17:48:28.452 INFO 6 --- [ main] com.hazelcast.instance.Node : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
2017-03-20 17:48:28.716 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
2017-03-20 17:48:28.726 INFO 6 --- [ main] c.h.s.i.o.impl.OperationExecutorImpl : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
2017-03-20 17:48:28.737 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
2017-03-20 17:48:28.738 INFO 6 --- [ main] c.h.n.t.n.NonBlockingIOThreadingModel : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
2017-03-20 17:48:28.769 INFO 6 --- [ main] com.hazelcast.cluster.impl.TcpIpJoiner : [10.180.3.14]:5701 [someGroup] [3.7.5]
Members [1] {
Member [10.180.3.14]:5701 - fd46c90d-ff0a-40cf-8a98-afba10f24924 this
}
2017-03-20 17:48:28.836 INFO 6 --- [ main] com.hazelcast.core.LifecycleService : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
2017-03-20 17:48:28.850 INFO 6 --- [ main] com.github.pires.hazelcast.Application : Started Application in 5.286 seconds (JVM running for 6.211)
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
<exec.CodeExitError>: {
Err: {
s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-6skkk] [] <nil> error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f3c300 exit status 1 <nil> <nil> true [0xc420255118 0xc420255138 0xc420255150] [0xc420255118 0xc420255138 0xc420255150] [0xc420255130 0xc420255148] [0xc37db0 0xc37db0] 0xc42146a780 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
},
Code: 1,
}
error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-6skkk] [] <nil> error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
[] <nil> 0xc420f3c300 exit status 1 <nil> <nil> true [0xc420255118 0xc420255138 0xc420255150] [0xc420255118 0xc420255138 0xc420255150] [0xc420255130 0xc420255148] [0xc37db0 0xc37db0] 0xc42146a780 <nil>}:
Command stdout:
stderr:
error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
error:
exit status 1
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
<*errors.errorString | 0xc4220f82c0>: {
s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-hww3g\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO 18:10:16 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO 18:10:17 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hww3g}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO 18:10:17 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO 18:10:17 Global memtable on-heap threshold is enabled at 128MB\nINFO 18:10:17 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:10:17 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server. See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
}
Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
CASSANDRA_CONF_DIR /etc/cassandra
CASSANDRA_CFG /etc/cassandra/cassandra.yaml
CASSANDRA_AUTO_BOOTSTRAP true
CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
CASSANDRA_CLUSTER_NAME 'Test Cluster'
CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
CASSANDRA_CONCURRENT_COMPACTORS
CASSANDRA_CONCURRENT_READS
CASSANDRA_CONCURRENT_WRITES
CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
CASSANDRA_DC
CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
CASSANDRA_GC_WARN_THRESHOLD_IN_MS
CASSANDRA_INTERNODE_COMPRESSION
CASSANDRA_KEY_CACHE_SIZE_IN_MB
CASSANDRA_LISTEN_ADDRESS 10.180.1.13
CASSANDRA_LISTEN_INTERFACE
CASSANDRA_MEMTABLE_ALLOCATION_TYPE
CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
CASSANDRA_MEMTABLE_FLUSH_WRITERS
CASSANDRA_MIGRATION_WAIT 1
CASSANDRA_NUM_TOKENS 32
CASSANDRA_RACK
CASSANDRA_RING_DELAY 30000
CASSANDRA_RPC_ADDRESS 0.0.0.0
CASSANDRA_RPC_INTERFACE
CASSANDRA_SEEDS cassandra-hww3g
CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
changed ownership of '/etc/cassandra' from root to cassandra
OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory
INFO 18:10:16 Configuration location: file:/etc/cassandra/cassandra.yaml
INFO 18:10:17 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hww3g}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
INFO 18:10:17 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
INFO 18:10:17 Global memtable on-heap threshold is enabled at 128MB
INFO 18:10:17 Global memtable off-heap threshold is enabled at 128MB
Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
ERROR 18:10:17 Exception encountered during startup
org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
Fatal configuration error; unable to start server. See log for stacktrace.
at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
"
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250
Issues about this test specifically: #27978 #28817 #39574 #43344
https://storage.googleapis.com/k8s-gubernator/triage/index.html#451144a9be5d4451ad3c
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4198/ Multiple broken tests:
Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}
Issues about this test specifically: #27850 #30672 #33271
Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}
Issues about this test specifically: #36323 #36469 #38222
Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}
Issues about this test specifically: #27978 #28817 #39574
Failed: Test {e2e.go}
Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025
Previous issues for this suite: #36930 #37437 #38393 #38578 #39379 #40341 #43015