kubernetes / kubernetes

Production-Grade Container Scheduling and Management
https://kubernetes.io
Apache License 2.0
107.27k stars 38.55k forks source link

ci-kubernetes-e2e-gce-examples: broken test run #43193

Closed k8s-github-robot closed 7 years ago

k8s-github-robot commented 7 years ago

https://storage.googleapis.com/k8s-gubernator/triage/index.html#451144a9be5d4451ad3c

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4198/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4211e6310>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 04:39:24.296  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-xzmwt with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 04:39:24.319  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 04:39:24.435  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 04:39:24 GMT 2017]; root of context hierarchy\n2017-03-16 04:39:26.181  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 04:39:26.202  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 04:39:26.855  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed\n\njava.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]\n\tat com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]\n\tat org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]\n\tat java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]\n\tat org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]\n\n2017-03-16 04:39:26.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.\n2017-03-16 04:39:26.990  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []\n2017-03-16 04:39:26.992  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 04:39:26.992  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.\n2017-03-16 04:39:27.009  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 04:39:27.045  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 04:39:27.404  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 04:39:28.250  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 04:39:28.527  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 04:39:28.537  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 04:39:28.546  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-16 04:39:28.552  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 04:39:28.594  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 2ea824d1-646d-467c-a70f-d7aedc318e9f this\n}\n\n2017-03-16 04:39:28.671  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-16 04:39:28.676  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.313 seconds (JVM running for 6.194)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 04:39:24.296  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-xzmwt with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 04:39:24.319  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 04:39:24.435  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 04:39:24 GMT 2017]; root of context hierarchy
    2017-03-16 04:39:26.181  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 04:39:26.202  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 04:39:26.855  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed

    java.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]
        at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]
        at com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]
        at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]
        at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]
        at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]
        at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]
        at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]

    2017-03-16 04:39:26.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.
    2017-03-16 04:39:26.990  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []
    2017-03-16 04:39:26.992  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 04:39:26.992  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.
    2017-03-16 04:39:27.009  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
    2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 04:39:27.045  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 04:39:27.404  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 04:39:28.250  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 04:39:28.527  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 04:39:28.537  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 04:39:28.546  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
    2017-03-16 04:39:28.552  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 04:39:28.594  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.6]:5701 - 2ea824d1-646d-467c-a70f-d7aedc318e9f this
    }

    2017-03-16 04:39:28.671  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
    2017-03-16 04:39:28.676  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.313 seconds (JVM running for 6.194)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5frwm] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420fd98f0 exit status 1 <nil> <nil> true [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886e0 0xc4204886f8] [0xc35000 0xc35000] 0xc420d5d800 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5frwm] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420fd98f0 exit status 1 <nil> <nil> true [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886e0 0xc4204886f8] [0xc35000 0xc35000] 0xc420d5d800 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421357f70>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3bthz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:04:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:04:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3bthz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:04:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:04:41 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:04:41 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:04:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3bthz
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  05:04:40 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:04:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3bthz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:04:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:04:41 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:04:41 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:04:41 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Previous issues for this suite: #36930 #37437 #38393 #38578 #39379 #40341 #43015

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4249/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-qfsm7] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4203e76b0 exit status 1 <nil> <nil> true [0xc4202628a8 0xc4202628c0 0xc4202628d8] [0xc4202628a8 0xc4202628c0 0xc4202628d8] [0xc4202628b8 0xc4202628d0] [0xc37850 0xc37850] 0xc4210fd4a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-qfsm7] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4203e76b0 exit status 1 <nil> <nil> true [0xc4202628a8 0xc4202628c0 0xc4202628d8] [0xc4202628a8 0xc4202628c0 0xc4202628d8] [0xc4202628b8 0xc4202628d0] [0xc37850 0xc37850] 0xc4210fd4a0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4208c0440>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 08:55:51.290  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-sl590 with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-18 08:55:51.312  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 08:55:51.459  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 08:55:51 GMT 2017]; root of context hierarchy\n2017-03-18 08:55:53.395  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 08:55:53.417  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 08:55:54.040  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 08:55:54.158  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.21]\n2017-03-18 08:55:54.158  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 08:55:54.172  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 08:55:54.211  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.21]:5701\n2017-03-18 08:55:54.212  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 08:55:54.213  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 08:55:54.697  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.21]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 08:55:55.612  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.3.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 08:55:55.922  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 08:55:55.937  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 08:55:55.953  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTING\n2017-03-18 08:55:55.957  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 08:55:56.013  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.21]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.21]:5701 - bfdf32a4-4fd5-4136-be31-9d1ffdd1665b this\n}\n\n2017-03-18 08:55:56.091  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTED\n2017-03-18 08:55:56.099  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.839 seconds (JVM running for 6.848)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 08:55:51.290  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-sl590 with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-18 08:55:51.312  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 08:55:51.459  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 08:55:51 GMT 2017]; root of context hierarchy
    2017-03-18 08:55:53.395  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 08:55:53.417  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 08:55:54.040  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 08:55:54.158  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.21]
    2017-03-18 08:55:54.158  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 08:55:54.172  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 08:55:54.211  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.21]:5701
    2017-03-18 08:55:54.212  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 08:55:54.213  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 08:55:54.697  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.21]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 08:55:55.612  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.3.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 08:55:55.922  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 08:55:55.937  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 08:55:55.953  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTING
    2017-03-18 08:55:55.957  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 08:55:56.013  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.21]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.21]:5701 - bfdf32a4-4fd5-4136-be31-9d1ffdd1665b this
    }

    2017-03-18 08:55:56.091  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTED
    2017-03-18 08:55:56.099  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.839 seconds (JVM running for 6.848)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421148550>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-4kwx5\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  09:11:04 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  09:11:04 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4kwx5}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  09:11:04 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  09:11:04 Global memtable on-heap threshold is enabled at 128MB\nINFO  09:11:04 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:11:04 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-4kwx5
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  09:11:04 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  09:11:04 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4kwx5}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  09:11:04 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  09:11:04 Global memtable on-heap threshold is enabled at 128MB
    INFO  09:11:04 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 09:11:04 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4250/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42145dfd0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-32j32\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  09:55:05 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  09:55:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-32j32}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  09:55:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  09:55:05 Global memtable on-heap threshold is enabled at 128MB\nINFO  09:55:05 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:55:05 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-32j32
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  09:55:05 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  09:55:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-32j32}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  09:55:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  09:55:05 Global memtable on-heap threshold is enabled at 128MB
    INFO  09:55:05 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 09:55:05 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4212e4210>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 09:57:39.447  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-nv4g5 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 09:57:39.457  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 09:57:39.554  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 09:57:39 GMT 2017]; root of context hierarchy\n2017-03-18 09:57:41.300  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 09:57:41.319  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 09:57:41.899  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 09:57:42.011  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.9]\n2017-03-18 09:57:42.011  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 09:57:42.022  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 09:57:42.056  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.9]:5701\n2017-03-18 09:57:42.056  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 09:57:42.056  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 09:57:42.419  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 09:57:43.288  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 09:57:43.537  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 09:57:43.548  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 09:57:43.571  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTING\n2017-03-18 09:57:43.578  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 09:57:43.599  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.9]:5701 - 3ad1c0db-a408-41b1-9ca2-df9b5c1bf48a this\n}\n\n2017-03-18 09:57:43.670  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTED\n2017-03-18 09:57:43.673  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.198 seconds (JVM running for 6.075)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 09:57:39.447  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-nv4g5 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-18 09:57:39.457  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 09:57:39.554  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 09:57:39 GMT 2017]; root of context hierarchy
    2017-03-18 09:57:41.300  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 09:57:41.319  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 09:57:41.899  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 09:57:42.011  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.9]
    2017-03-18 09:57:42.011  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 09:57:42.022  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 09:57:42.056  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.9]:5701
    2017-03-18 09:57:42.056  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 09:57:42.056  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 09:57:42.419  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 09:57:43.288  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 09:57:43.537  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 09:57:43.548  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 09:57:43.571  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTING
    2017-03-18 09:57:43.578  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 09:57:43.599  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.9]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.9]:5701 - 3ad1c0db-a408-41b1-9ca2-df9b5c1bf48a this
    }

    2017-03-18 09:57:43.670  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTED
    2017-03-18 09:57:43.673  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.198 seconds (JVM running for 6.075)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.205.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-bmn61] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42135d080 exit status 1 <nil> <nil> true [0xc420e62208 0xc420e62220 0xc420e62238] [0xc420e62208 0xc420e62220 0xc420e62238] [0xc420e62218 0xc420e62230] [0xc37850 0xc37850] 0xc420dad320 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.205.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-bmn61] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42135d080 exit status 1 <nil> <nil> true [0xc420e62208 0xc420e62220 0xc420e62238] [0xc420e62208 0xc420e62220 0xc420e62238] [0xc420e62218 0xc420e62230] [0xc37850 0xc37850] 0xc420dad320 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4251/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420a55b40>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-786bk\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  10:57:53 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  10:57:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-786bk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  10:57:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  10:57:53 Global memtable on-heap threshold is enabled at 128MB\nINFO  10:57:53 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 10:57:53 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-786bk
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  10:57:53 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  10:57:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-786bk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  10:57:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  10:57:53 Global memtable on-heap threshold is enabled at 128MB
    INFO  10:57:53 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 10:57:53 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l21g5] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42172cab0 exit status 1 <nil> <nil> true [0xc42027a730 0xc42027a778 0xc42027a7a8] [0xc42027a730 0xc42027a778 0xc42027a7a8] [0xc42027a760 0xc42027a790] [0xc37850 0xc37850] 0xc4210ca720 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l21g5] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42172cab0 exit status 1 <nil> <nil> true [0xc42027a730 0xc42027a778 0xc42027a7a8] [0xc42027a730 0xc42027a778 0xc42027a7a8] [0xc42027a760 0xc42027a790] [0xc37850 0xc37850] 0xc4210ca720 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421eb29b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 11:02:25.861  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-107kw with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 11:02:25.871  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 11:02:26.063  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 11:02:26 GMT 2017]; root of context hierarchy\n2017-03-18 11:02:28.059  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 11:02:28.081  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 11:02:28.777  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 11:02:28.908  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.12]\n2017-03-18 11:02:28.908  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 11:02:28.919  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 11:02:28.960  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.12]:5701\n2017-03-18 11:02:28.960  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 11:02:28.960  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 11:02:29.329  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.12]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 11:02:30.347  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 11:02:30.670  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 11:02:30.677  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 11:02:30.716  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTING\n2017-03-18 11:02:30.721  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 11:02:30.777  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.12]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.12]:5701 - 928cd02b-1978-4888-a40d-64665b107cc5 this\n}\n\n2017-03-18 11:02:30.864  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTED\n2017-03-18 11:02:30.870  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.028 seconds (JVM running for 6.918)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 11:02:25.861  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-107kw with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 11:02:25.871  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 11:02:26.063  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 11:02:26 GMT 2017]; root of context hierarchy
    2017-03-18 11:02:28.059  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 11:02:28.081  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 11:02:28.777  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 11:02:28.908  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.12]
    2017-03-18 11:02:28.908  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 11:02:28.919  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 11:02:28.960  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.12]:5701
    2017-03-18 11:02:28.960  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 11:02:28.960  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 11:02:29.329  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.12]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 11:02:30.347  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 11:02:30.670  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 11:02:30.677  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 11:02:30.716  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTING
    2017-03-18 11:02:30.721  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 11:02:30.777  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.12]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.12]:5701 - 928cd02b-1978-4888-a40d-64665b107cc5 this
    }

    2017-03-18 11:02:30.864  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTED
    2017-03-18 11:02:30.870  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.028 seconds (JVM running for 6.918)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4252/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421cb65b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-vx4hf\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  12:22:14 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  12:22:15 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vx4hf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  12:22:15 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  12:22:15 Global memtable on-heap threshold is enabled at 128MB\nINFO  12:22:15 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 12:22:15 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-vx4hf
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  12:22:14 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  12:22:15 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vx4hf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  12:22:15 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  12:22:15 Global memtable on-heap threshold is enabled at 128MB
    INFO  12:22:15 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 12:22:15 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xrgf0] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420a06f90 exit status 1 <nil> <nil> true [0xc420038e10 0xc420038e28 0xc420038e50] [0xc420038e10 0xc420038e28 0xc420038e50] [0xc420038e20 0xc420038e40] [0xc37850 0xc37850] 0xc420d80d20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xrgf0] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420a06f90 exit status 1 <nil> <nil> true [0xc420038e10 0xc420038e28 0xc420038e50] [0xc420038e10 0xc420038e28 0xc420038e50] [0xc420038e20 0xc420038e40] [0xc37850 0xc37850] 0xc420d80d20 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4215d9320>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 12:00:22.995  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wqcms with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 12:00:23.022  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 12:00:23.101  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 12:00:23 GMT 2017]; root of context hierarchy\n2017-03-18 12:00:24.714  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 12:00:24.735  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 12:00:25.328  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 12:00:25.466  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.15]\n2017-03-18 12:00:25.467  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 12:00:25.479  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 12:00:25.522  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.15]:5701\n2017-03-18 12:00:25.522  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 12:00:25.522  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 12:00:25.887  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 12:00:26.764  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 12:00:27.037  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 12:00:27.040  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 12:00:27.049  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.15]:5701 [someGroup] [3.7.5] [10.180.2.15]:5701 is STARTING\n2017-03-18 12:00:27.062  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 12:00:27.132  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.15]:5701 - b5f02728-4503-4ca8-9aa3-2ff39cdb3516 this\n}\n\n2017-03-18 12:00:27.236  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.15]:5701 [someGroup] [3.7.5] [10.180.2.15]:5701 is STARTED\n2017-03-18 12:00:27.245  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.191 seconds (JVM running for 6.158)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 12:00:22.995  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wqcms with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-18 12:00:23.022  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 12:00:23.101  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 12:00:23 GMT 2017]; root of context hierarchy
    2017-03-18 12:00:24.714  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 12:00:24.735  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 12:00:25.328  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 12:00:25.466  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.15]
    2017-03-18 12:00:25.467  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 12:00:25.479  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 12:00:25.522  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.15]:5701
    2017-03-18 12:00:25.522  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 12:00:25.522  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 12:00:25.887  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 12:00:26.764  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 12:00:27.037  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 12:00:27.040  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 12:00:27.049  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.15]:5701 [someGroup] [3.7.5] [10.180.2.15]:5701 is STARTING
    2017-03-18 12:00:27.062  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 12:00:27.132  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.15]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.15]:5701 - b5f02728-4503-4ca8-9aa3-2ff39cdb3516 this
    }

    2017-03-18 12:00:27.236  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.15]:5701 [someGroup] [3.7.5] [10.180.2.15]:5701 is STARTED
    2017-03-18 12:00:27.245  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.191 seconds (JVM running for 6.158)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4253/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4218806b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.24\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.24\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.24\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.24\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-4h8x8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  13:28:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  13:28:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.24; broadcast_rpc_address=10.180.1.24; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.24; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4h8x8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  13:28:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  13:28:40 Global memtable on-heap threshold is enabled at 128MB\nINFO  13:28:40 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:28:40 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.24
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.24
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.24
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.24
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-4h8x8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  13:28:40 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  13:28:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.24; broadcast_rpc_address=10.180.1.24; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.24; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4h8x8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  13:28:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  13:28:40 Global memtable on-heap threshold is enabled at 128MB
    INFO  13:28:40 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 13:28:40 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420871500>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 13:08:36.701  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-1t6b8 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 13:08:36.729  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 13:08:36.859  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 13:08:36 GMT 2017]; root of context hierarchy\n2017-03-18 13:08:38.576  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 13:08:38.595  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 13:08:39.288  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 13:08:39.441  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.17]\n2017-03-18 13:08:39.441  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 13:08:39.454  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 13:08:39.491  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.17]:5701\n2017-03-18 13:08:39.491  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 13:08:39.491  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 13:08:39.850  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 13:08:40.755  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 13:08:41.078  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 13:08:41.085  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 13:08:41.118  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTING\n2017-03-18 13:08:41.122  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 13:08:41.150  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.17]:5701 - 0e82d064-88c9-4713-8d2b-f1f73cb14b10 this\n}\n\n2017-03-18 13:08:41.245  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTED\n2017-03-18 13:08:41.253  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.559 seconds (JVM running for 6.541)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 13:08:36.701  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-1t6b8 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-18 13:08:36.729  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 13:08:36.859  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 13:08:36 GMT 2017]; root of context hierarchy
    2017-03-18 13:08:38.576  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 13:08:38.595  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 13:08:39.288  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 13:08:39.441  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.17]
    2017-03-18 13:08:39.441  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 13:08:39.454  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 13:08:39.491  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.17]:5701
    2017-03-18 13:08:39.491  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 13:08:39.491  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 13:08:39.850  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 13:08:40.755  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 13:08:41.078  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 13:08:41.085  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 13:08:41.118  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTING
    2017-03-18 13:08:41.122  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 13:08:41.150  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.17]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.17]:5701 - 0e82d064-88c9-4713-8d2b-f1f73cb14b10 this
    }

    2017-03-18 13:08:41.245  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.17]:5701 [someGroup] [3.7.5] [10.180.1.17]:5701 is STARTED
    2017-03-18 13:08:41.253  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.559 seconds (JVM running for 6.541)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-sfb8x] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4217a5590 exit status 1 <nil> <nil> true [0xc4202b42f0 0xc4202b4328 0xc4202b4380] [0xc4202b42f0 0xc4202b4328 0xc4202b4380] [0xc4202b4320 0xc4202b4368] [0xc37850 0xc37850] 0xc4210b2480 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-sfb8x] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4217a5590 exit status 1 <nil> <nil> true [0xc4202b42f0 0xc4202b4328 0xc4202b4380] [0xc4202b42f0 0xc4202b4328 0xc4202b4380] [0xc4202b4320 0xc4202b4368] [0xc37850 0xc37850] 0xc4210b2480 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4254/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tqc2k] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420805590 exit status 1 <nil> <nil> true [0xc42032c3d0 0xc42032c3e8 0xc42032c400] [0xc42032c3d0 0xc42032c3e8 0xc42032c400] [0xc42032c3e0 0xc42032c3f8] [0xc37850 0xc37850] 0xc4213a6b40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tqc2k] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420805590 exit status 1 <nil> <nil> true [0xc42032c3d0 0xc42032c3e8 0xc42032c400] [0xc42032c3d0 0xc42032c3e8 0xc42032c400] [0xc42032c3e0 0xc42032c3f8] [0xc37850 0xc37850] 0xc4213a6b40 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420dcebb0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.23\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.23\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.23\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.23\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-73c76\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  14:34:35 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  14:34:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.23; broadcast_rpc_address=10.180.1.23; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.23; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-73c76}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  14:34:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  14:34:36 Global memtable on-heap threshold is enabled at 128MB\nINFO  14:34:36 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:34:36 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.23
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.23
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.23
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.23
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-73c76
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  14:34:35 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  14:34:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.23; broadcast_rpc_address=10.180.1.23; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.23; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-73c76}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  14:34:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  14:34:36 Global memtable on-heap threshold is enabled at 128MB
    INFO  14:34:36 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 14:34:36 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420e360c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 14:11:15.508  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-xn8v6 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 14:11:15.515  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 14:11:15.629  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 14:11:15 GMT 2017]; root of context hierarchy\n2017-03-18 14:11:17.122  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 14:11:17.147  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 14:11:17.773  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 14:11:17.890  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-18 14:11:17.891  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 14:11:17.903  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 14:11:17.938  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-18 14:11:17.938  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 14:11:17.938  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 14:11:18.318  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 14:11:19.234  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 14:11:19.614  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 14:11:19.622  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 14:11:19.632  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-18 14:11:19.634  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 14:11:19.690  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - c0b14448-a294-4c36-a9db-9bf4d0022eaa this\n}\n\n2017-03-18 14:11:19.769  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-18 14:11:19.774  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.263 seconds (JVM running for 6.223)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 14:11:15.508  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-xn8v6 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 14:11:15.515  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 14:11:15.629  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 14:11:15 GMT 2017]; root of context hierarchy
    2017-03-18 14:11:17.122  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 14:11:17.147  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 14:11:17.773  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 14:11:17.890  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
    2017-03-18 14:11:17.891  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 14:11:17.903  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 14:11:17.938  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
    2017-03-18 14:11:17.938  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 14:11:17.938  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 14:11:18.318  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 14:11:19.234  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 14:11:19.614  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 14:11:19.622  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 14:11:19.632  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
    2017-03-18 14:11:19.634  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 14:11:19.690  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.16]:5701 - c0b14448-a294-4c36-a9db-9bf4d0022eaa this
    }

    2017-03-18 14:11:19.769  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
    2017-03-18 14:11:19.774  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.263 seconds (JVM running for 6.223)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4255/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42129ca20>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-szrmn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  15:19:41 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  15:19:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-szrmn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  15:19:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  15:19:41 Global memtable on-heap threshold is enabled at 128MB\nINFO  15:19:41 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:19:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-szrmn
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  15:19:41 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  15:19:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-szrmn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  15:19:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  15:19:41 Global memtable on-heap threshold is enabled at 128MB
    INFO  15:19:41 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 15:19:41 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4207e4500>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 15:27:27.100  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-2jvtn with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 15:27:27.108  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 15:27:27.245  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 15:27:27 GMT 2017]; root of context hierarchy\n2017-03-18 15:27:29.013  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 15:27:29.034  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 15:27:29.710  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 15:27:29.859  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.11]\n2017-03-18 15:27:29.859  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 15:27:29.870  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 15:27:29.906  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.11]:5701\n2017-03-18 15:27:29.907  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 15:27:29.907  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 15:27:30.285  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.11]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 15:27:31.171  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 15:27:31.463  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 15:27:31.473  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 15:27:31.499  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTING\n2017-03-18 15:27:31.503  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 15:27:31.533  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.11]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.11]:5701 - ddd84679-9f14-451a-829a-7c4f678a8cbc this\n}\n\n2017-03-18 15:27:31.615  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTED\n2017-03-18 15:27:31.621  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.522 seconds (JVM running for 6.37)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 15:27:27.100  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-2jvtn with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-18 15:27:27.108  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 15:27:27.245  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 15:27:27 GMT 2017]; root of context hierarchy
    2017-03-18 15:27:29.013  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 15:27:29.034  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 15:27:29.710  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 15:27:29.859  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.11]
    2017-03-18 15:27:29.859  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 15:27:29.870  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 15:27:29.906  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.11]:5701
    2017-03-18 15:27:29.907  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 15:27:29.907  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 15:27:30.285  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.11]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 15:27:31.171  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 15:27:31.463  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 15:27:31.473  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 15:27:31.499  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTING
    2017-03-18 15:27:31.503  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 15:27:31.533  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.11]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.11]:5701 - ddd84679-9f14-451a-829a-7c4f678a8cbc this
    }

    2017-03-18 15:27:31.615  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTED
    2017-03-18 15:27:31.621  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.522 seconds (JVM running for 6.37)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-k2lt8] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ec5440 exit status 1 <nil> <nil> true [0xc420038c50 0xc420038c68 0xc420038c88] [0xc420038c50 0xc420038c68 0xc420038c88] [0xc420038c60 0xc420038c78] [0xc37850 0xc37850] 0xc421ff3800 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.145.141 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-k2lt8] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ec5440 exit status 1 <nil> <nil> true [0xc420038c50 0xc420038c68 0xc420038c88] [0xc420038c50 0xc420038c68 0xc420038c88] [0xc420038c60 0xc420038c78] [0xc37850 0xc37850] 0xc421ff3800 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4257/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4207de610>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-17cxm\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  17:40:52 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  17:40:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-17cxm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  17:40:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  17:40:53 Global memtable on-heap threshold is enabled at 128MB\nINFO  17:40:53 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:40:53 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-17cxm
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  17:40:52 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  17:40:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-17cxm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  17:40:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  17:40:53 Global memtable on-heap threshold is enabled at 128MB
    INFO  17:40:53 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 17:40:53 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4208a8430>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 17:46:20.559  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-dzn4h with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 17:46:20.567  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 17:46:20.726  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 17:46:20 GMT 2017]; root of context hierarchy\n2017-03-18 17:46:22.701  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 17:46:22.730  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 17:46:23.461  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 17:46:23.582  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.21]\n2017-03-18 17:46:23.583  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 17:46:23.596  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 17:46:23.632  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.21]:5701\n2017-03-18 17:46:23.633  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 17:46:23.633  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 17:46:23.973  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.21]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 17:46:24.881  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 17:46:25.183  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 17:46:25.191  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 17:46:25.200  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTING\n2017-03-18 17:46:25.203  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 17:46:25.231  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.21]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.21]:5701 - a744a6bb-420c-40f2-89b3-fd0de4a493ee this\n}\n\n2017-03-18 17:46:25.306  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTED\n2017-03-18 17:46:25.310  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.769 seconds (JVM running for 6.726)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 17:46:20.559  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-dzn4h with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 17:46:20.567  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 17:46:20.726  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 17:46:20 GMT 2017]; root of context hierarchy
    2017-03-18 17:46:22.701  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 17:46:22.730  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 17:46:23.461  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 17:46:23.582  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.21]
    2017-03-18 17:46:23.583  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 17:46:23.596  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 17:46:23.632  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.21]:5701
    2017-03-18 17:46:23.633  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 17:46:23.633  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 17:46:23.973  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.21]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 17:46:24.881  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 17:46:25.183  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 17:46:25.191  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 17:46:25.200  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTING
    2017-03-18 17:46:25.203  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 17:46:25.231  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.21]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.21]:5701 - a744a6bb-420c-40f2-89b3-fd0de4a493ee this
    }

    2017-03-18 17:46:25.306  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTED
    2017-03-18 17:46:25.310  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.769 seconds (JVM running for 6.726)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jkc5z] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4212fe4b0 exit status 1 <nil> <nil> true [0xc4202fab70 0xc4202fab98 0xc4202fabc8] [0xc4202fab70 0xc4202fab98 0xc4202fabc8] [0xc4202fab80 0xc4202fabc0] [0xc37850 0xc37850] 0xc420bd4600 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jkc5z] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4212fe4b0 exit status 1 <nil> <nil> true [0xc4202fab70 0xc4202fab98 0xc4202fabc8] [0xc4202fab70 0xc4202fab98 0xc4202fabc8] [0xc4202fab80 0xc4202fabc0] [0xc37850 0xc37850] 0xc420bd4600 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4258/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.53.178 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5zrj6] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420cefbf0 exit status 1 <nil> <nil> true [0xc420ec46e8 0xc420ec4710 0xc420ec4740] [0xc420ec46e8 0xc420ec4710 0xc420ec4740] [0xc420ec46f8 0xc420ec4730] [0xc37850 0xc37850] 0xc420a50c00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://146.148.53.178 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5zrj6] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420cefbf0 exit status 1 <nil> <nil> true [0xc420ec46e8 0xc420ec4710 0xc420ec4740] [0xc420ec46e8 0xc420ec4710 0xc420ec4740] [0xc420ec46f8 0xc420ec4730] [0xc37850 0xc37850] 0xc420a50c00 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421c58a70>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.16\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.16\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.16\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-hbsd4\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:48:30 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:48:31 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hbsd4}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:48:31 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:48:31 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:48:31 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:48:31 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.16
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.16
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.16
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-hbsd4
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  18:48:30 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:48:31 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hbsd4}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:48:31 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:48:31 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:48:31 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:48:31 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421cda230>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 18:51:23.005  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0g8pz with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 18:51:23.015  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 18:51:23.146  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 18:51:23 GMT 2017]; root of context hierarchy\n2017-03-18 18:51:24.667  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 18:51:24.687  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 18:51:25.296  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 18:51:25.465  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-18 18:51:25.465  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 18:51:25.476  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 18:51:25.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-18 18:51:25.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 18:51:25.509  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 18:51:25.841  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 18:51:26.706  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 18:51:27.092  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 18:51:27.096  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 18:51:27.105  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-18 18:51:27.110  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 18:51:27.179  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - ad0a47ce-7f8c-4af7-be72-861f3cfefe6a this\n}\n\n2017-03-18 18:51:27.259  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-18 18:51:27.265  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.246 seconds (JVM running for 6.156)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 18:51:23.005  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0g8pz with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 18:51:23.015  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 18:51:23.146  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 18:51:23 GMT 2017]; root of context hierarchy
    2017-03-18 18:51:24.667  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 18:51:24.687  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 18:51:25.296  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 18:51:25.465  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
    2017-03-18 18:51:25.465  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 18:51:25.476  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 18:51:25.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
    2017-03-18 18:51:25.508  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 18:51:25.509  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 18:51:25.841  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 18:51:26.706  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 18:51:27.092  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 18:51:27.096  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 18:51:27.105  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
    2017-03-18 18:51:27.110  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 18:51:27.179  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.16]:5701 - ad0a47ce-7f8c-4af7-be72-861f3cfefe6a this
    }

    2017-03-18 18:51:27.259  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
    2017-03-18 18:51:27.265  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.246 seconds (JVM running for 6.156)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4259/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42115a3f0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 19:36:23.596  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wb6kb with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-18 19:36:23.612  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 19:36:23.723  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 19:36:23 GMT 2017]; root of context hierarchy\n2017-03-18 19:36:25.417  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 19:36:25.436  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 19:36:26.050  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 19:36:26.191  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.8]\n2017-03-18 19:36:26.192  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 19:36:26.203  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 19:36:26.236  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701\n2017-03-18 19:36:26.237  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 19:36:26.237  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 19:36:26.595  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 19:36:27.433  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 19:36:27.720  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 19:36:27.729  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 19:36:27.741  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING\n2017-03-18 19:36:27.747  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 19:36:27.782  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.8]:5701 - ba3a6d3c-a5cb-4fb1-8901-5d953e5b38b0 this\n}\n\n2017-03-18 19:36:27.840  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED\n2017-03-18 19:36:27.855  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.238 seconds (JVM running for 6.078)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 19:36:23.596  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wb6kb with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-18 19:36:23.612  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 19:36:23.723  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 19:36:23 GMT 2017]; root of context hierarchy
    2017-03-18 19:36:25.417  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 19:36:25.436  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 19:36:26.050  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 19:36:26.191  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.8]
    2017-03-18 19:36:26.192  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 19:36:26.203  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 19:36:26.236  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701
    2017-03-18 19:36:26.237  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 19:36:26.237  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 19:36:26.595  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 19:36:27.433  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 19:36:27.720  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 19:36:27.729  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 19:36:27.741  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING
    2017-03-18 19:36:27.747  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 19:36:27.782  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.8]:5701 - ba3a6d3c-a5cb-4fb1-8901-5d953e5b38b0 this
    }

    2017-03-18 19:36:27.840  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED
    2017-03-18 19:36:27.855  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.238 seconds (JVM running for 6.078)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xz1kj] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421072480 exit status 1 <nil> <nil> true [0xc4200389a0 0xc420038a08 0xc420038a38] [0xc4200389a0 0xc420038a08 0xc420038a38] [0xc4200389f8 0xc420038a28] [0xc37850 0xc37850] 0xc420b5aa20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xz1kj] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421072480 exit status 1 <nil> <nil> true [0xc4200389a0 0xc420038a08 0xc420038a38] [0xc4200389a0 0xc420038a08 0xc420038a38] [0xc4200389f8 0xc420038a28] [0xc37850 0xc37850] 0xc420b5aa20 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42157d3e0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.22\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.22\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.22\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.22\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-5gt04\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  20:06:55 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  20:06:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.22; broadcast_rpc_address=10.180.1.22; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.22; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5gt04}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  20:06:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  20:06:56 Global memtable on-heap threshold is enabled at 128MB\nINFO  20:06:56 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 20:06:56 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.22
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.22
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.22
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.22
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-5gt04
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  20:06:55 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  20:06:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.22; broadcast_rpc_address=10.180.1.22; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.22; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5gt04}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  20:06:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  20:06:56 Global memtable on-heap threshold is enabled at 128MB
    INFO  20:06:56 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 20:06:56 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4260/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421ebedd0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-q2m7n\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  21:11:23 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  21:11:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q2m7n}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  21:11:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  21:11:23 Global memtable on-heap threshold is enabled at 128MB\nINFO  21:11:23 Global memtable off-heap threshold is enabled at 128MB\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\nERROR 21:11:23 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-q2m7n
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  21:11:23 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  21:11:23 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q2m7n}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  21:11:23 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  21:11:23 Global memtable on-heap threshold is enabled at 128MB
    INFO  21:11:23 Global memtable off-heap threshold is enabled at 128MB
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    ERROR 21:11:23 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420d26080>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 20:51:10.246  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-7kvlg with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 20:51:10.259  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 20:51:10.326  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 20:51:10 GMT 2017]; root of context hierarchy\n2017-03-18 20:51:12.123  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 20:51:12.143  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 20:51:12.775  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 20:51:12.886  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.9]\n2017-03-18 20:51:12.886  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 20:51:12.899  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 20:51:12.932  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.9]:5701\n2017-03-18 20:51:12.932  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 20:51:12.932  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 20:51:13.403  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 20:51:14.251  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 20:51:14.537  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 20:51:14.549  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 20:51:14.557  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTING\n2017-03-18 20:51:14.561  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 20:51:14.580  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.9]:5701 - b73a0fe7-d309-4605-99f1-a377537fea03 this\n}\n\n2017-03-18 20:51:14.644  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTED\n2017-03-18 20:51:14.655  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.479 seconds (JVM running for 6.322)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 20:51:10.246  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-7kvlg with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 20:51:10.259  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 20:51:10.326  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 20:51:10 GMT 2017]; root of context hierarchy
    2017-03-18 20:51:12.123  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 20:51:12.143  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 20:51:12.775  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 20:51:12.886  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.9]
    2017-03-18 20:51:12.886  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 20:51:12.899  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 20:51:12.932  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.9]:5701
    2017-03-18 20:51:12.932  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 20:51:12.932  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 20:51:13.403  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 20:51:14.251  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 20:51:14.537  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 20:51:14.549  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 20:51:14.557  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTING
    2017-03-18 20:51:14.561  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 20:51:14.580  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.9]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.9]:5701 - b73a0fe7-d309-4605-99f1-a377537fea03 this
    }

    2017-03-18 20:51:14.644  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTED
    2017-03-18 20:51:14.655  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.479 seconds (JVM running for 6.322)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-d9kff] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42075ac00 exit status 1 <nil> <nil> true [0xc4205885e0 0xc4205885f8 0xc420588618] [0xc4205885e0 0xc4205885f8 0xc420588618] [0xc4205885f0 0xc420588608] [0xc37850 0xc37850] 0xc420f02f00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-d9kff] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42075ac00 exit status 1 <nil> <nil> true [0xc4205885e0 0xc4205885f8 0xc420588618] [0xc4205885e0 0xc4205885f8 0xc420588618] [0xc4205885f0 0xc420588608] [0xc37850 0xc37850] 0xc420f02f00 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4261/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42179a800>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 21:57:27.520  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-csxj2 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 21:57:27.528  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 21:57:27.678  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 21:57:27 GMT 2017]; root of context hierarchy\n2017-03-18 21:57:29.347  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 21:57:29.376  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 21:57:30.022  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 21:57:30.176  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.5]\n2017-03-18 21:57:30.177  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 21:57:30.189  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 21:57:30.226  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.5]:5701\n2017-03-18 21:57:30.226  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 21:57:30.226  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 21:57:30.618  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.5]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 21:57:31.622  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.5]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 21:57:31.915  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 21:57:31.918  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 21:57:31.927  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTING\n2017-03-18 21:57:31.932  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.5]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 21:57:31.958  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.5]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.5]:5701 - e7f18455-4361-4085-8ed0-59b000910c7e this\n}\n\n2017-03-18 21:57:32.020  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTED\n2017-03-18 21:57:32.031  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.52 seconds (JVM running for 6.442)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 21:57:27.520  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-csxj2 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 21:57:27.528  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 21:57:27.678  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 21:57:27 GMT 2017]; root of context hierarchy
    2017-03-18 21:57:29.347  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 21:57:29.376  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 21:57:30.022  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 21:57:30.176  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.5]
    2017-03-18 21:57:30.177  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 21:57:30.189  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 21:57:30.226  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.5]:5701
    2017-03-18 21:57:30.226  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 21:57:30.226  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 21:57:30.618  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.5]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 21:57:31.622  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.5]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 21:57:31.915  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 21:57:31.918  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 21:57:31.927  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTING
    2017-03-18 21:57:31.932  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.5]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 21:57:31.958  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.5]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.5]:5701 - e7f18455-4361-4085-8ed0-59b000910c7e this
    }

    2017-03-18 21:57:32.020  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTED
    2017-03-18 21:57:32.031  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.52 seconds (JVM running for 6.442)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-c18gx] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c1b800 exit status 1 <nil> <nil> true [0xc420b144e0 0xc420b14508 0xc420b14528] [0xc420b144e0 0xc420b14508 0xc420b14528] [0xc420b144f8 0xc420b14520] [0xc37850 0xc37850] 0xc420dfaa20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-c18gx] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420c1b800 exit status 1 <nil> <nil> true [0xc420b144e0 0xc420b14508 0xc420b14528] [0xc420b144e0 0xc420b14508 0xc420b14528] [0xc420b144f8 0xc420b14520] [0xc37850 0xc37850] 0xc420dfaa20 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421358080>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.4\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.4\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.4\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.4\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0plsw\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  21:54:47 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  21:54:47 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.4; broadcast_rpc_address=10.180.3.4; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.4; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0plsw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  21:54:47 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  21:54:47 Global memtable on-heap threshold is enabled at 128MB\nINFO  21:54:47 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 21:54:47 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.4
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.4
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.4
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.4
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0plsw
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  21:54:47 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  21:54:47 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.4; broadcast_rpc_address=10.180.3.4; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.4; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0plsw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  21:54:47 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  21:54:47 Global memtable on-heap threshold is enabled at 128MB
    INFO  21:54:47 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 21:54:47 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4263/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4208ac040>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2p8kd\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  00:09:56 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  00:09:57 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2p8kd}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  00:09:57 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  00:09:57 Global memtable on-heap threshold is enabled at 128MB\nINFO  00:09:57 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 00:09:57 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-2p8kd
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  00:09:56 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  00:09:57 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2p8kd}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  00:09:57 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  00:09:57 Global memtable on-heap threshold is enabled at 128MB
    INFO  00:09:57 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 00:09:57 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4214e6f30>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 00:20:22.260  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-b7dft with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 00:20:22.268  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 00:20:22.401  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 00:20:22 GMT 2017]; root of context hierarchy\n2017-03-19 00:20:24.194  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 00:20:24.215  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 00:20:24.933  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 00:20:25.046  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.24]\n2017-03-19 00:20:25.047  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 00:20:25.061  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.24]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 00:20:25.095  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.24]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.24]:5701\n2017-03-19 00:20:25.095  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.24]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 00:20:25.095  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.24]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 00:20:25.449  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.24]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 00:20:26.346  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.24]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 00:20:26.631  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.24]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 00:20:26.646  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.24]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 00:20:26.667  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.24]:5701 [someGroup] [3.7.5] [10.180.2.24]:5701 is STARTING\n2017-03-19 00:20:26.670  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.24]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 00:20:26.720  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.24]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.24]:5701 - 2d53fdd2-91b0-4df8-b1ca-7c15e6e3c44e this\n}\n\n2017-03-19 00:20:26.805  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.24]:5701 [someGroup] [3.7.5] [10.180.2.24]:5701 is STARTED\n2017-03-19 00:20:26.813  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.464 seconds (JVM running for 6.341)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 00:20:22.260  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-b7dft with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 00:20:22.268  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 00:20:22.401  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 00:20:22 GMT 2017]; root of context hierarchy
    2017-03-19 00:20:24.194  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 00:20:24.215  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 00:20:24.933  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 00:20:25.046  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.24]
    2017-03-19 00:20:25.047  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 00:20:25.061  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.24]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 00:20:25.095  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.24]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.24]:5701
    2017-03-19 00:20:25.095  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.24]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 00:20:25.095  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.24]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 00:20:25.449  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.24]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 00:20:26.346  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.24]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 00:20:26.631  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.24]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 00:20:26.646  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.24]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 00:20:26.667  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.24]:5701 [someGroup] [3.7.5] [10.180.2.24]:5701 is STARTING
    2017-03-19 00:20:26.670  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.24]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 00:20:26.720  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.24]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.24]:5701 - 2d53fdd2-91b0-4df8-b1ca-7c15e6e3c44e this
    }

    2017-03-19 00:20:26.805  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.24]:5701 [someGroup] [3.7.5] [10.180.2.24]:5701 is STARTED
    2017-03-19 00:20:26.813  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.464 seconds (JVM running for 6.341)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-48bn8] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421017dd0 exit status 1 <nil> <nil> true [0xc42065e3b0 0xc42065e3c8 0xc42065e3e0] [0xc42065e3b0 0xc42065e3c8 0xc42065e3e0] [0xc42065e3c0 0xc42065e3d8] [0xc37850 0xc37850] 0xc4214552c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-48bn8] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421017dd0 exit status 1 <nil> <nil> true [0xc42065e3b0 0xc42065e3c8 0xc42065e3e0] [0xc42065e3b0 0xc42065e3c8 0xc42065e3e0] [0xc42065e3c0 0xc42065e3d8] [0xc37850 0xc37850] 0xc4214552c0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4264/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4214680f0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-fbpkm\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  01:24:20 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  01:24:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fbpkm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  01:24:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  01:24:20 Global memtable on-heap threshold is enabled at 128MB\nINFO  01:24:20 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:24:20 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-fbpkm
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  01:24:20 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  01:24:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fbpkm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  01:24:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  01:24:20 Global memtable on-heap threshold is enabled at 128MB
    INFO  01:24:20 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 01:24:20 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.189.130 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-crpqh] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42138a7b0 exit status 1 <nil> <nil> true [0xc4202b51d8 0xc4202b51f0 0xc4202b5210] [0xc4202b51d8 0xc4202b51f0 0xc4202b5210] [0xc4202b51e8 0xc4202b5208] [0xc37850 0xc37850] 0xc4209ee7e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.189.130 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-crpqh] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42138a7b0 exit status 1 <nil> <nil> true [0xc4202b51d8 0xc4202b51f0 0xc4202b5210] [0xc4202b51d8 0xc4202b51f0 0xc4202b5210] [0xc4202b51e8 0xc4202b5208] [0xc37850 0xc37850] 0xc4209ee7e0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420edefa0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 01:08:57.213  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-43xvq with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 01:08:57.220  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 01:08:57.325  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 01:08:57 GMT 2017]; root of context hierarchy\n2017-03-19 01:08:59.035  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 01:08:59.054  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 01:08:59.686  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 01:08:59.803  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.13]\n2017-03-19 01:08:59.803  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 01:08:59.816  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 01:08:59.848  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.13]:5701\n2017-03-19 01:08:59.849  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 01:08:59.849  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 01:09:00.207  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 01:09:01.239  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 01:09:01.609  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 01:09:01.612  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 01:09:01.641  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTING\n2017-03-19 01:09:01.646  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 01:09:01.681  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.13]:5701 - 5f29cf48-08c4-48e0-ad65-ef6ef5c33ba0 this\n}\n\n2017-03-19 01:09:01.765  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTED\n2017-03-19 01:09:01.774  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.614 seconds (JVM running for 6.48)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 01:08:57.213  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-43xvq with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 01:08:57.220  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 01:08:57.325  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 01:08:57 GMT 2017]; root of context hierarchy
    2017-03-19 01:08:59.035  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 01:08:59.054  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 01:08:59.686  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 01:08:59.803  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.13]
    2017-03-19 01:08:59.803  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 01:08:59.816  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 01:08:59.848  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.13]:5701
    2017-03-19 01:08:59.849  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 01:08:59.849  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 01:09:00.207  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 01:09:01.239  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 01:09:01.609  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 01:09:01.612  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 01:09:01.641  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTING
    2017-03-19 01:09:01.646  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 01:09:01.681  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.13]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.13]:5701 - 5f29cf48-08c4-48e0-ad65-ef6ef5c33ba0 this
    }

    2017-03-19 01:09:01.765  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTED
    2017-03-19 01:09:01.774  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.614 seconds (JVM running for 6.48)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4265/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-mxl3h] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420a58ea0 exit status 1 <nil> <nil> true [0xc420470890 0xc4204708b8 0xc420470928] [0xc420470890 0xc4204708b8 0xc420470928] [0xc4204708a0 0xc4204708f8] [0xc37850 0xc37850] 0xc4211fd7a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-mxl3h] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420a58ea0 exit status 1 <nil> <nil> true [0xc420470890 0xc4204708b8 0xc420470928] [0xc420470890 0xc4204708b8 0xc420470928] [0xc4204708a0 0xc4204708f8] [0xc37850 0xc37850] 0xc4211fd7a0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42089cbd0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-bm4gj\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  02:13:26 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  02:13:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bm4gj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  02:13:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  02:13:26 Global memtable on-heap threshold is enabled at 128MB\nINFO  02:13:26 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 02:13:26 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-bm4gj
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  02:13:26 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  02:13:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bm4gj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  02:13:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  02:13:26 Global memtable on-heap threshold is enabled at 128MB
    INFO  02:13:26 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 02:13:26 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421118590>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 02:16:12.711  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0z3bx with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 02:16:12.721  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 02:16:12.817  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 02:16:12 GMT 2017]; root of context hierarchy\n2017-03-19 02:16:15.379  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 02:16:15.429  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 02:16:16.535  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 02:16:16.784  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-19 02:16:16.785  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 02:16:16.817  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 02:16:16.874  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-19 02:16:16.875  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 02:16:16.875  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 02:16:17.413  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 02:16:18.568  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 02:16:18.927  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 02:16:18.949  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 02:16:18.989  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-19 02:16:18.994  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 02:16:19.050  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - 3f6364e6-a7eb-4ac3-a4ec-3467927c803f this\n}\n\n2017-03-19 02:16:19.155  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-19 02:16:19.159  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 7.891 seconds (JVM running for 9.217)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 02:16:12.711  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0z3bx with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-19 02:16:12.721  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 02:16:12.817  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 02:16:12 GMT 2017]; root of context hierarchy
    2017-03-19 02:16:15.379  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 02:16:15.429  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 02:16:16.535  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 02:16:16.784  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
    2017-03-19 02:16:16.785  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 02:16:16.817  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 02:16:16.874  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
    2017-03-19 02:16:16.875  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 02:16:16.875  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 02:16:17.413  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 02:16:18.568  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 02:16:18.927  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 02:16:18.949  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 02:16:18.989  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
    2017-03-19 02:16:18.994  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 02:16:19.050  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.14]:5701 - 3f6364e6-a7eb-4ac3-a4ec-3467927c803f this
    }

    2017-03-19 02:16:19.155  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
    2017-03-19 02:16:19.159  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 7.891 seconds (JVM running for 9.217)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4266/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-w8dm0] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ea6ae0 exit status 1 <nil> <nil> true [0xc420280408 0xc420280420 0xc420280438] [0xc420280408 0xc420280420 0xc420280438] [0xc420280418 0xc420280430] [0xc37850 0xc37850] 0xc42127ab40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.225.85 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-w8dm0] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ea6ae0 exit status 1 <nil> <nil> true [0xc420280408 0xc420280420 0xc420280438] [0xc420280408 0xc420280420 0xc420280438] [0xc420280418 0xc420280430] [0xc37850 0xc37850] 0xc42127ab40 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421d58050>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 03:15:55.883  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-c3hpr with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 03:15:55.891  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 03:15:55.978  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 03:15:55 GMT 2017]; root of context hierarchy\n2017-03-19 03:15:57.748  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 03:15:57.770  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 03:15:58.415  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 03:15:58.537  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]\n2017-03-19 03:15:58.537  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 03:15:58.550  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 03:15:58.585  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-19 03:15:58.586  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 03:15:58.586  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 03:15:58.958  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 03:15:59.779  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 03:16:00.044  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 03:16:00.047  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 03:16:00.079  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-19 03:16:00.083  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 03:16:00.131  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 39cd86cf-a127-447e-b192-9c528d7c12be this\n}\n\n2017-03-19 03:16:00.215  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-19 03:16:00.219  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.324 seconds (JVM running for 6.224)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 03:15:55.883  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-c3hpr with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 03:15:55.891  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 03:15:55.978  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 03:15:55 GMT 2017]; root of context hierarchy
    2017-03-19 03:15:57.748  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 03:15:57.770  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 03:15:58.415  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 03:15:58.537  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]
    2017-03-19 03:15:58.537  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 03:15:58.550  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 03:15:58.585  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
    2017-03-19 03:15:58.586  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 03:15:58.586  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 03:15:58.958  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 03:15:59.779  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 03:16:00.044  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 03:16:00.047  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 03:16:00.079  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
    2017-03-19 03:16:00.083  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 03:16:00.131  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.6]:5701 - 39cd86cf-a127-447e-b192-9c528d7c12be this
    }

    2017-03-19 03:16:00.215  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
    2017-03-19 03:16:00.219  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.324 seconds (JVM running for 6.224)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421698310>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-6mnf2\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  03:13:23 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  03:13:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6mnf2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  03:13:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  03:13:24 Global memtable on-heap threshold is enabled at 128MB\nINFO  03:13:24 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 03:13:24 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-6mnf2
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  03:13:23 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  03:13:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6mnf2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  03:13:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  03:13:24 Global memtable on-heap threshold is enabled at 128MB
    INFO  03:13:24 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 03:13:24 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4267/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420f91090>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 04:14:27.588  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hp9cj with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 04:14:27.597  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 04:14:27.754  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 04:14:27 GMT 2017]; root of context hierarchy\n2017-03-19 04:14:29.494  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 04:14:29.517  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 04:14:30.202  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 04:14:30.345  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.7]\n2017-03-19 04:14:30.346  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 04:14:30.359  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 04:14:30.392  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.7]:5701\n2017-03-19 04:14:30.393  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 04:14:30.393  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 04:14:30.748  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.7]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 04:14:31.639  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 04:14:31.975  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 04:14:31.990  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 04:14:32.003  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTING\n2017-03-19 04:14:32.005  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 04:14:32.056  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.7]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.7]:5701 - 9a56fa83-4a52-4074-a5be-dc49a08c0aee this\n}\n\n2017-03-19 04:14:32.145  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTED\n2017-03-19 04:14:32.151  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.639 seconds (JVM running for 6.506)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 04:14:27.588  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hp9cj with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 04:14:27.597  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 04:14:27.754  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 04:14:27 GMT 2017]; root of context hierarchy
    2017-03-19 04:14:29.494  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 04:14:29.517  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 04:14:30.202  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 04:14:30.345  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.7]
    2017-03-19 04:14:30.346  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 04:14:30.359  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 04:14:30.392  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.7]:5701
    2017-03-19 04:14:30.393  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 04:14:30.393  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 04:14:30.748  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.7]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 04:14:31.639  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 04:14:31.975  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 04:14:31.990  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 04:14:32.003  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTING
    2017-03-19 04:14:32.005  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 04:14:32.056  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.7]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.7]:5701 - 9a56fa83-4a52-4074-a5be-dc49a08c0aee this
    }

    2017-03-19 04:14:32.145  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTED
    2017-03-19 04:14:32.151  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.639 seconds (JVM running for 6.506)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-hp0bj] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42137a6f0 exit status 1 <nil> <nil> true [0xc420038168 0xc420038198 0xc4200381b8] [0xc420038168 0xc420038198 0xc4200381b8] [0xc420038180 0xc4200381b0] [0xc37850 0xc37850] 0xc421902a20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-hp0bj] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42137a6f0 exit status 1 <nil> <nil> true [0xc420038168 0xc420038198 0xc4200381b8] [0xc420038168 0xc420038198 0xc4200381b8] [0xc420038180 0xc4200381b0] [0xc37850 0xc37850] 0xc421902a20 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421538e80>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-j2kqz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  04:36:33 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  04:36:34 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.12; broadcast_rpc_address=10.180.1.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j2kqz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  04:36:34 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  04:36:34 Global memtable on-heap threshold is enabled at 128MB\nINFO  04:36:34 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 04:36:34 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-j2kqz
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  04:36:33 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  04:36:34 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.12; broadcast_rpc_address=10.180.1.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j2kqz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  04:36:34 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  04:36:34 Global memtable on-heap threshold is enabled at 128MB
    INFO  04:36:34 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 04:36:34 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4268/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1kvd4] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42124e150 exit status 1 <nil> <nil> true [0xc4202fea48 0xc4202fea88 0xc4202feac8] [0xc4202fea48 0xc4202fea88 0xc4202feac8] [0xc4202fea68 0xc4202feab8] [0xc37850 0xc37850] 0xc420cb7500 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.159.149 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1kvd4] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42124e150 exit status 1 <nil> <nil> true [0xc4202fea48 0xc4202fea88 0xc4202feac8] [0xc4202fea48 0xc4202fea88 0xc4202feac8] [0xc4202fea68 0xc4202feab8] [0xc37850 0xc37850] 0xc420cb7500 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421da2060>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 05:33:44.802  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bcrc2 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 05:33:44.810  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 05:33:44.898  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 05:33:44 GMT 2017]; root of context hierarchy\n2017-03-19 05:33:46.562  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 05:33:46.582  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 05:33:47.241  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 05:33:47.385  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.11]\n2017-03-19 05:33:47.386  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 05:33:47.398  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 05:33:47.434  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.11]:5701\n2017-03-19 05:33:47.434  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 05:33:47.435  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 05:33:47.771  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.11]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 05:33:48.646  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 05:33:48.944  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 05:33:48.955  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 05:33:48.964  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTING\n2017-03-19 05:33:48.967  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 05:33:49.015  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.11]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.11]:5701 - ff76442d-370d-4209-88d5-6f4ea33e3ecf this\n}\n\n2017-03-19 05:33:49.094  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTED\n2017-03-19 05:33:49.101  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.298 seconds (JVM running for 6.191)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 05:33:44.802  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bcrc2 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 05:33:44.810  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 05:33:44.898  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 05:33:44 GMT 2017]; root of context hierarchy
    2017-03-19 05:33:46.562  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 05:33:46.582  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 05:33:47.241  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 05:33:47.385  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.11]
    2017-03-19 05:33:47.386  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 05:33:47.398  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 05:33:47.434  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.11]:5701
    2017-03-19 05:33:47.434  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 05:33:47.435  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 05:33:47.771  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.11]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 05:33:48.646  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 05:33:48.944  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 05:33:48.955  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 05:33:48.964  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTING
    2017-03-19 05:33:48.967  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 05:33:49.015  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.11]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.11]:5701 - ff76442d-370d-4209-88d5-6f4ea33e3ecf this
    }

    2017-03-19 05:33:49.094  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.11]:5701 [someGroup] [3.7.5] [10.180.1.11]:5701 is STARTED
    2017-03-19 05:33:49.101  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.298 seconds (JVM running for 6.191)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4212200a0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2gf1s\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:25:01 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:25:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2gf1s}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:25:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:25:02 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:25:02 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:25:02 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-2gf1s
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  05:25:01 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:25:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2gf1s}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:25:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:25:02 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:25:02 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:25:02 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

fejta commented 7 years ago

/unassign /assign @quinton-hoole

My instinct would just be to delete these tests as from my perspective they just create noise. Do you know someone willing to fix and maintain them?

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4269/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421f24730>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.16\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.16\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.16\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-r017k\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:50:34 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:50:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-r017k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:50:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:50:35 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:50:35 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:50:35 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.16
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.16
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.16
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-r017k
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  06:50:34 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:50:35 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-r017k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:50:35 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:50:35 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:50:35 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:50:35 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jdfs4] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42153fe30 exit status 1 <nil> <nil> true [0xc42030e3b0 0xc42030e3d8 0xc42030e408] [0xc42030e3b0 0xc42030e3d8 0xc42030e408] [0xc42030e3c8 0xc42030e3f0] [0xc37850 0xc37850] 0xc42105ccc0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jdfs4] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42153fe30 exit status 1 <nil> <nil> true [0xc42030e3b0 0xc42030e3d8 0xc42030e408] [0xc42030e3b0 0xc42030e3d8 0xc42030e408] [0xc42030e3c8 0xc42030e3f0] [0xc37850 0xc37850] 0xc42105ccc0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4219ea520>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 06:30:33.483  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-pgxzz with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-19 06:30:33.491  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 06:30:33.652  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 06:30:33 GMT 2017]; root of context hierarchy\n2017-03-19 06:30:35.656  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 06:30:35.683  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 06:30:36.321  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 06:30:36.450  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.13]\n2017-03-19 06:30:36.451  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 06:30:36.462  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 06:30:36.498  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.13]:5701\n2017-03-19 06:30:36.498  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 06:30:36.498  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 06:30:36.850  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 06:30:37.777  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 06:30:38.049  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 06:30:38.054  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 06:30:38.067  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTING\n2017-03-19 06:30:38.070  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 06:30:38.090  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.13]:5701 - 0010eb31-e8c1-48c4-8593-a6f7556f5e65 this\n}\n\n2017-03-19 06:30:38.179  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTED\n2017-03-19 06:30:38.182  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.796 seconds (JVM running for 6.775)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 06:30:33.483  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-pgxzz with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-19 06:30:33.491  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 06:30:33.652  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 06:30:33 GMT 2017]; root of context hierarchy
    2017-03-19 06:30:35.656  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 06:30:35.683  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 06:30:36.321  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 06:30:36.450  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.13]
    2017-03-19 06:30:36.451  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 06:30:36.462  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 06:30:36.498  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.13]:5701
    2017-03-19 06:30:36.498  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 06:30:36.498  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 06:30:36.850  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 06:30:37.777  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 06:30:38.049  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 06:30:38.054  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 06:30:38.067  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTING
    2017-03-19 06:30:38.070  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 06:30:38.090  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.13]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.13]:5701 - 0010eb31-e8c1-48c4-8593-a6f7556f5e65 this
    }

    2017-03-19 06:30:38.179  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTED
    2017-03-19 06:30:38.182  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.796 seconds (JVM running for 6.775)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4270/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42084b220>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-03zkt\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  07:31:02 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  07:31:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-03zkt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  07:31:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  07:31:02 Global memtable on-heap threshold is enabled at 128MB\nINFO  07:31:02 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 07:31:02 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-03zkt
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  07:31:02 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  07:31:02 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-03zkt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  07:31:02 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  07:31:02 Global memtable on-heap threshold is enabled at 128MB
    INFO  07:31:02 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 07:31:02 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420e3f300>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 07:35:35.965  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-j5x34 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 07:35:35.972  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 07:35:36.044  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 07:35:36 GMT 2017]; root of context hierarchy\n2017-03-19 07:35:37.798  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 07:35:37.823  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 07:35:38.438  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 07:35:38.565  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]\n2017-03-19 07:35:38.565  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 07:35:38.577  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 07:35:38.609  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701\n2017-03-19 07:35:38.609  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 07:35:38.609  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 07:35:38.969  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 07:35:39.911  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 07:35:40.188  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 07:35:40.203  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 07:35:40.246  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING\n2017-03-19 07:35:40.247  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 07:35:40.313  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.8]:5701 - a22f9be8-c293-4abf-8aac-e9739a32fa73 this\n}\n\n2017-03-19 07:35:40.393  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED\n2017-03-19 07:35:40.395  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.344 seconds (JVM running for 6.251)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 07:35:35.965  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-j5x34 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-19 07:35:35.972  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 07:35:36.044  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 07:35:36 GMT 2017]; root of context hierarchy
    2017-03-19 07:35:37.798  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 07:35:37.823  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 07:35:38.438  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 07:35:38.565  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]
    2017-03-19 07:35:38.565  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 07:35:38.577  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 07:35:38.609  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701
    2017-03-19 07:35:38.609  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 07:35:38.609  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 07:35:38.969  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 07:35:39.911  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 07:35:40.188  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 07:35:40.203  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 07:35:40.246  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING
    2017-03-19 07:35:40.247  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 07:35:40.313  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.8]:5701 - a22f9be8-c293-4abf-8aac-e9739a32fa73 this
    }

    2017-03-19 07:35:40.393  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED
    2017-03-19 07:35:40.395  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.344 seconds (JVM running for 6.251)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.177.48 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-79mzn] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42175bd70 exit status 1 <nil> <nil> true [0xc420592c28 0xc420592c70 0xc420592cd0] [0xc420592c28 0xc420592c70 0xc420592cd0] [0xc420592c58 0xc420592ca0] [0xc37850 0xc37850] 0xc421770480 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.177.48 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-79mzn] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42175bd70 exit status 1 <nil> <nil> true [0xc420592c28 0xc420592c70 0xc420592cd0] [0xc420592c28 0xc420592c70 0xc420592cd0] [0xc420592c58 0xc420592ca0] [0xc37850 0xc37850] 0xc421770480 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4271/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4215262a0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.0.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.0.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.0.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-79n2m\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  08:53:51 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  08:53:51 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.15; broadcast_rpc_address=10.180.0.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-79n2m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  08:53:51 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  08:53:52 Global memtable on-heap threshold is enabled at 128MB\nINFO  08:53:52 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 08:53:52 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.0.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.0.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.0.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-79n2m
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  08:53:51 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  08:53:51 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.15; broadcast_rpc_address=10.180.0.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-79n2m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  08:53:51 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  08:53:52 Global memtable on-heap threshold is enabled at 128MB
    INFO  08:53:52 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 08:53:52 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420d44b10>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 08:31:54.322  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0l7dw with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 08:31:54.330  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 08:31:54.432  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 08:31:54 GMT 2017]; root of context hierarchy\n2017-03-19 08:31:56.003  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 08:31:56.023  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 08:31:56.690  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 08:31:56.797  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.8]\n2017-03-19 08:31:56.798  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 08:31:56.811  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 08:31:56.843  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.8]:5701\n2017-03-19 08:31:56.843  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 08:31:56.844  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 08:31:57.166  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 08:31:58.211  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.0.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 08:31:58.469  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 08:31:58.477  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 08:31:58.486  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.8]:5701 [someGroup] [3.7.5] [10.180.0.8]:5701 is STARTING\n2017-03-19 08:31:58.487  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 08:31:58.535  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.0.8]:5701 - a893000a-9e3a-411a-9e79-cc3c3a995d6b this\n}\n\n2017-03-19 08:31:58.635  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.8]:5701 [someGroup] [3.7.5] [10.180.0.8]:5701 is STARTED\n2017-03-19 08:31:58.642  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.346 seconds (JVM running for 6.386)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 08:31:54.322  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0l7dw with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 08:31:54.330  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 08:31:54.432  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 08:31:54 GMT 2017]; root of context hierarchy
    2017-03-19 08:31:56.003  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 08:31:56.023  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 08:31:56.690  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 08:31:56.797  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.8]
    2017-03-19 08:31:56.798  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 08:31:56.811  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 08:31:56.843  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.8]:5701
    2017-03-19 08:31:56.843  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 08:31:56.844  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 08:31:57.166  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 08:31:58.211  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.0.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 08:31:58.469  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 08:31:58.477  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 08:31:58.486  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.8]:5701 [someGroup] [3.7.5] [10.180.0.8]:5701 is STARTING
    2017-03-19 08:31:58.487  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 08:31:58.535  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.0.8]:5701 - a893000a-9e3a-411a-9e79-cc3c3a995d6b this
    }

    2017-03-19 08:31:58.635  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.8]:5701 [someGroup] [3.7.5] [10.180.0.8]:5701 is STARTED
    2017-03-19 08:31:58.642  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.346 seconds (JVM running for 6.386)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-s7lz7] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42111a870 exit status 1 <nil> <nil> true [0xc420038110 0xc420038138 0xc420038160] [0xc420038110 0xc420038138 0xc420038160] [0xc420038130 0xc420038150] [0xc37850 0xc37850] 0xc420a1aba0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-s7lz7] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42111a870 exit status 1 <nil> <nil> true [0xc420038110 0xc420038138 0xc420038160] [0xc420038110 0xc420038138 0xc420038160] [0xc420038130 0xc420038150] [0xc37850 0xc37850] 0xc420a1aba0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4272/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421d3c030>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 10:01:23.827  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-7xd6c with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 10:01:23.842  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 10:01:23.940  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 10:01:23 GMT 2017]; root of context hierarchy\n2017-03-19 10:01:25.673  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 10:01:25.710  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 10:01:26.387  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 10:01:26.516  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.22]\n2017-03-19 10:01:26.516  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 10:01:26.529  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 10:01:26.559  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.22]:5701\n2017-03-19 10:01:26.559  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 10:01:26.559  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 10:01:26.860  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.22]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 10:01:27.672  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 10:01:27.976  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 10:01:27.984  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 10:01:28.012  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.22]:5701 [someGroup] [3.7.5] [10.180.1.22]:5701 is STARTING\n2017-03-19 10:01:28.017  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 10:01:28.045  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.22]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.22]:5701 - 83f807e8-4a98-4d62-80e7-38d5b33e5343 this\n}\n\n2017-03-19 10:01:28.120  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.22]:5701 [someGroup] [3.7.5] [10.180.1.22]:5701 is STARTED\n2017-03-19 10:01:28.125  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.241 seconds (JVM running for 6.111)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 10:01:23.827  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-7xd6c with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 10:01:23.842  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 10:01:23.940  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 10:01:23 GMT 2017]; root of context hierarchy
    2017-03-19 10:01:25.673  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 10:01:25.710  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 10:01:26.387  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 10:01:26.516  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.22]
    2017-03-19 10:01:26.516  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 10:01:26.529  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 10:01:26.559  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.22]:5701
    2017-03-19 10:01:26.559  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 10:01:26.559  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 10:01:26.860  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.22]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 10:01:27.672  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 10:01:27.976  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 10:01:27.984  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 10:01:28.012  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.22]:5701 [someGroup] [3.7.5] [10.180.1.22]:5701 is STARTING
    2017-03-19 10:01:28.017  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 10:01:28.045  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.22]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.22]:5701 - 83f807e8-4a98-4d62-80e7-38d5b33e5343 this
    }

    2017-03-19 10:01:28.120  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.22]:5701 [someGroup] [3.7.5] [10.180.1.22]:5701 is STARTED
    2017-03-19 10:01:28.125  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.241 seconds (JVM running for 6.111)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-x438v] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f4fbf0 exit status 1 <nil> <nil> true [0xc42075ed40 0xc42075ed58 0xc42075ed70] [0xc42075ed40 0xc42075ed58 0xc42075ed70] [0xc42075ed50 0xc42075ed68] [0xc37850 0xc37850] 0xc4212f5f80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-x438v] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f4fbf0 exit status 1 <nil> <nil> true [0xc42075ed40 0xc42075ed58 0xc42075ed70] [0xc42075ed40 0xc42075ed58 0xc42075ed70] [0xc42075ed50 0xc42075ed68] [0xc37850 0xc37850] 0xc4212f5f80 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421cdc450>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-dnvpn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  09:53:19 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  09:53:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dnvpn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  09:53:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  09:53:19 Global memtable on-heap threshold is enabled at 128MB\nINFO  09:53:19 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:53:19 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-dnvpn
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  09:53:19 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  09:53:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.9; broadcast_rpc_address=10.180.2.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dnvpn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  09:53:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  09:53:19 Global memtable on-heap threshold is enabled at 128MB
    INFO  09:53:19 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 09:53:19 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4273/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420f729d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 10:56:10.816  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-n223b with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 10:56:10.832  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 10:56:10.920  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 10:56:10 GMT 2017]; root of context hierarchy\n2017-03-19 10:56:12.694  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 10:56:12.713  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 10:56:13.274  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 10:56:13.400  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]\n2017-03-19 10:56:13.400  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 10:56:13.412  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 10:56:13.448  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701\n2017-03-19 10:56:13.448  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 10:56:13.448  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 10:56:13.838  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 10:56:14.690  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 10:56:14.951  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 10:56:14.965  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 10:56:14.989  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING\n2017-03-19 10:56:14.996  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 10:56:15.029  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.17]:5701 - 9fff8020-c9ef-4ee1-8520-6ebbcb482b59 this\n}\n\n2017-03-19 10:56:15.093  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED\n2017-03-19 10:56:15.105  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.313 seconds (JVM running for 6.077)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 10:56:10.816  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-n223b with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 10:56:10.832  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 10:56:10.920  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 10:56:10 GMT 2017]; root of context hierarchy
    2017-03-19 10:56:12.694  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 10:56:12.713  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 10:56:13.274  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 10:56:13.400  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]
    2017-03-19 10:56:13.400  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 10:56:13.412  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 10:56:13.448  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701
    2017-03-19 10:56:13.448  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 10:56:13.448  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 10:56:13.838  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 10:56:14.690  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 10:56:14.951  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 10:56:14.965  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 10:56:14.989  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING
    2017-03-19 10:56:14.996  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 10:56:15.029  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.17]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.17]:5701 - 9fff8020-c9ef-4ee1-8520-6ebbcb482b59 this
    }

    2017-03-19 10:56:15.093  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED
    2017-03-19 10:56:15.105  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.313 seconds (JVM running for 6.077)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421df24d0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.18\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.18\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.18\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.18\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-rml51\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:11:19 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:11:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.18; broadcast_rpc_address=10.180.2.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-rml51}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:11:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:11:19 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:11:19 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:11:19 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.18
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.18
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.18
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.18
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-rml51
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  11:11:19 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:11:19 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.18; broadcast_rpc_address=10.180.2.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-rml51}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:11:19 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:11:19 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:11:19 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 11:11:19 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-h3spn] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421453920 exit status 1 <nil> <nil> true [0xc4200380e0 0xc420038100 0xc420038118] [0xc4200380e0 0xc420038100 0xc420038118] [0xc4200380f8 0xc420038110] [0xc37850 0xc37850] 0xc421232600 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-h3spn] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421453920 exit status 1 <nil> <nil> true [0xc4200380e0 0xc420038100 0xc420038118] [0xc4200380e0 0xc420038100 0xc420038118] [0xc4200380f8 0xc420038110] [0xc37850 0xc37850] 0xc421232600 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4274/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1gkcb] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4211c45d0 exit status 1 <nil> <nil> true [0xc4202b20f0 0xc4202b2108 0xc4202b2120] [0xc4202b20f0 0xc4202b2108 0xc4202b2120] [0xc4202b2100 0xc4202b2118] [0xc37850 0xc37850] 0xc4212a5140 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-1gkcb] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4211c45d0 exit status 1 <nil> <nil> true [0xc4202b20f0 0xc4202b2108 0xc4202b2120] [0xc4202b20f0 0xc4202b2108 0xc4202b2120] [0xc4202b2100 0xc4202b2118] [0xc37850 0xc37850] 0xc4212a5140 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421be25d0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-56v1b\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:59:49 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:59:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.8; broadcast_rpc_address=10.180.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-56v1b}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:59:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:59:49 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:59:49 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:59:49 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-56v1b
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  11:59:49 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:59:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.8; broadcast_rpc_address=10.180.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-56v1b}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:59:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:59:49 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:59:49 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 11:59:49 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421bd26b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 12:08:23.791  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-kdzft with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 12:08:23.807  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 12:08:23.984  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 12:08:23 GMT 2017]; root of context hierarchy\n2017-03-19 12:08:25.878  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 12:08:25.906  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 12:08:26.676  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 12:08:26.798  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-19 12:08:26.799  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 12:08:26.810  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 12:08:26.849  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-19 12:08:26.850  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 12:08:26.850  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 12:08:27.236  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 12:08:28.284  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 12:08:28.588  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 12:08:28.596  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 12:08:28.613  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-19 12:08:28.616  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 12:08:28.647  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - 61a258c6-8207-4a14-b1e7-6c6d5c05a21f this\n}\n\n2017-03-19 12:08:28.706  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-19 12:08:28.709  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.062 seconds (JVM running for 6.927)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 12:08:23.791  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-kdzft with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 12:08:23.807  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 12:08:23.984  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 12:08:23 GMT 2017]; root of context hierarchy
    2017-03-19 12:08:25.878  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 12:08:25.906  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 12:08:26.676  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 12:08:26.798  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
    2017-03-19 12:08:26.799  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 12:08:26.810  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 12:08:26.849  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
    2017-03-19 12:08:26.850  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 12:08:26.850  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 12:08:27.236  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 12:08:28.284  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 12:08:28.588  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 12:08:28.596  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 12:08:28.613  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
    2017-03-19 12:08:28.616  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 12:08:28.647  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.14]:5701 - 61a258c6-8207-4a14-b1e7-6c6d5c05a21f this
    }

    2017-03-19 12:08:28.706  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
    2017-03-19 12:08:28.709  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.062 seconds (JVM running for 6.927)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4275/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4214769a0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 13:08:29.622  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-s2f8r with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-19 13:08:29.630  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 13:08:29.754  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 13:08:29 GMT 2017]; root of context hierarchy\n2017-03-19 13:08:31.557  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 13:08:31.579  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 13:08:32.204  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 13:08:32.333  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.10]\n2017-03-19 13:08:32.334  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 13:08:32.347  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 13:08:32.383  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.10]:5701\n2017-03-19 13:08:32.383  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 13:08:32.383  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 13:08:32.753  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.10]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 13:08:33.595  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 13:08:33.873  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 13:08:33.881  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 13:08:33.896  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTING\n2017-03-19 13:08:33.899  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 13:08:33.950  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.10]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.10]:5701 - bddbac22-8bb7-44bf-9283-d9e31fa65b3c this\n}\n\n2017-03-19 13:08:34.047  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTED\n2017-03-19 13:08:34.053  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.531 seconds (JVM running for 6.418)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 13:08:29.622  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-s2f8r with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-19 13:08:29.630  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 13:08:29.754  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 13:08:29 GMT 2017]; root of context hierarchy
    2017-03-19 13:08:31.557  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 13:08:31.579  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 13:08:32.204  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 13:08:32.333  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.10]
    2017-03-19 13:08:32.334  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 13:08:32.347  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 13:08:32.383  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.10]:5701
    2017-03-19 13:08:32.383  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 13:08:32.383  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 13:08:32.753  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.10]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 13:08:33.595  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 13:08:33.873  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 13:08:33.881  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 13:08:33.896  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTING
    2017-03-19 13:08:33.899  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 13:08:33.950  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.10]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.10]:5701 - bddbac22-8bb7-44bf-9283-d9e31fa65b3c this
    }

    2017-03-19 13:08:34.047  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTED
    2017-03-19 13:08:34.053  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.531 seconds (JVM running for 6.418)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.194.253 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-clwmk] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420d02570 exit status 1 <nil> <nil> true [0xc420038ce0 0xc420038cf8 0xc420038d10] [0xc420038ce0 0xc420038cf8 0xc420038d10] [0xc420038cf0 0xc420038d08] [0xc37850 0xc37850] 0xc4216532c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.194.253 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-clwmk] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420d02570 exit status 1 <nil> <nil> true [0xc420038ce0 0xc420038cf8 0xc420038d10] [0xc420038ce0 0xc420038cf8 0xc420038d10] [0xc420038cf0 0xc420038d08] [0xc37850 0xc37850] 0xc4216532c0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421477270>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-ncz2j\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  13:03:28 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  13:03:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ncz2j}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  13:03:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  13:03:29 Global memtable on-heap threshold is enabled at 128MB\nINFO  13:03:29 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:03:29 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-ncz2j
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  13:03:28 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  13:03:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ncz2j}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  13:03:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  13:03:29 Global memtable on-heap threshold is enabled at 128MB
    INFO  13:03:29 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 13:03:29 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4276/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421b949e0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 14:01:00.408  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-cww5w with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 14:01:00.415  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 14:01:00.534  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 14:01:00 GMT 2017]; root of context hierarchy\n2017-03-19 14:01:02.315  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 14:01:02.339  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 14:01:03.086  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 14:01:03.190  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.9]\n2017-03-19 14:01:03.191  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 14:01:03.205  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 14:01:03.236  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.9]:5701\n2017-03-19 14:01:03.237  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 14:01:03.237  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 14:01:03.588  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 14:01:04.466  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 14:01:04.743  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 14:01:04.758  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 14:01:04.780  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTING\n2017-03-19 14:01:04.785  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 14:01:04.813  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.9]:5701 - 885df031-3fe6-44f3-8b46-fa418d6858b4 this\n}\n\n2017-03-19 14:01:04.903  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTED\n2017-03-19 14:01:04.905  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.567 seconds (JVM running for 6.418)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 14:01:00.408  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-cww5w with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 14:01:00.415  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 14:01:00.534  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 14:01:00 GMT 2017]; root of context hierarchy
    2017-03-19 14:01:02.315  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 14:01:02.339  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 14:01:03.086  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 14:01:03.190  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.9]
    2017-03-19 14:01:03.191  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 14:01:03.205  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 14:01:03.236  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.9]:5701
    2017-03-19 14:01:03.237  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 14:01:03.237  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 14:01:03.588  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 14:01:04.466  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 14:01:04.743  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 14:01:04.758  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 14:01:04.780  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTING
    2017-03-19 14:01:04.785  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 14:01:04.813  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.9]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.9]:5701 - 885df031-3fe6-44f3-8b46-fa418d6858b4 this
    }

    2017-03-19 14:01:04.903  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.9]:5701 [someGroup] [3.7.5] [10.180.3.9]:5701 is STARTED
    2017-03-19 14:01:04.905  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.567 seconds (JVM running for 6.418)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421b4f300>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.19\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.19\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.19\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.19\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-cn3lk\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  14:28:24 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  14:28:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.19; broadcast_rpc_address=10.180.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-cn3lk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  14:28:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  14:28:24 Global memtable on-heap threshold is enabled at 128MB\nINFO  14:28:24 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:28:24 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.19
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.19
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.19
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.19
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-cn3lk
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  14:28:24 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  14:28:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.19; broadcast_rpc_address=10.180.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-cn3lk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  14:28:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  14:28:24 Global memtable on-heap threshold is enabled at 128MB
    INFO  14:28:24 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 14:28:24 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.194.253 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-70pg1] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420d34960 exit status 1 <nil> <nil> true [0xc4204a48e0 0xc4204a4900 0xc4204a4920] [0xc4204a48e0 0xc4204a4900 0xc4204a4920] [0xc4204a48f0 0xc4204a4918] [0xc37850 0xc37850] 0xc420816120 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.194.253 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-70pg1] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420d34960 exit status 1 <nil> <nil> true [0xc4204a48e0 0xc4204a4900 0xc4204a4920] [0xc4204a48e0 0xc4204a4900 0xc4204a4920] [0xc4204a48f0 0xc4204a4918] [0xc37850 0xc37850] 0xc420816120 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4277/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ckh22] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420cdf410 exit status 1 <nil> <nil> true [0xc4200380f8 0xc4200381c8 0xc420038200] [0xc4200380f8 0xc4200381c8 0xc420038200] [0xc4200381c0 0xc4200381f8] [0xc37850 0xc37850] 0xc420b7cd80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ckh22] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420cdf410 exit status 1 <nil> <nil> true [0xc4200380f8 0xc4200381c8 0xc420038200] [0xc4200380f8 0xc4200381c8 0xc420038200] [0xc4200381c0 0xc4200381f8] [0xc37850 0xc37850] 0xc420b7cd80 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4213d21f0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 15:15:02.650  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-pp7hk with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 15:15:02.658  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 15:15:02.805  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 15:15:02 GMT 2017]; root of context hierarchy\n2017-03-19 15:15:04.643  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 15:15:04.668  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 15:15:05.350  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 15:15:05.477  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]\n2017-03-19 15:15:05.478  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 15:15:05.489  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 15:15:05.525  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701\n2017-03-19 15:15:05.526  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 15:15:05.526  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 15:15:05.911  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 15:15:07.158  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 15:15:07.460  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 15:15:07.468  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 15:15:07.479  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING\n2017-03-19 15:15:07.481  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 15:15:07.539  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.15]:5701 - c43501c7-dbe2-4321-9fcc-9b75d633bab2 this\n}\n\n2017-03-19 15:15:07.627  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED\n2017-03-19 15:15:07.639  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.23 seconds (JVM running for 7.237)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 15:15:02.650  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-pp7hk with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 15:15:02.658  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 15:15:02.805  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 15:15:02 GMT 2017]; root of context hierarchy
    2017-03-19 15:15:04.643  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 15:15:04.668  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 15:15:05.350  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 15:15:05.477  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]
    2017-03-19 15:15:05.478  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 15:15:05.489  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 15:15:05.525  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701
    2017-03-19 15:15:05.526  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 15:15:05.526  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 15:15:05.911  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 15:15:07.158  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 15:15:07.460  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 15:15:07.468  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 15:15:07.479  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING
    2017-03-19 15:15:07.481  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 15:15:07.539  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.15]:5701 - c43501c7-dbe2-4321-9fcc-9b75d633bab2 this
    }

    2017-03-19 15:15:07.627  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED
    2017-03-19 15:15:07.639  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.23 seconds (JVM running for 7.237)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421ec2840>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2wfc8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  15:35:07 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  15:35:07 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2wfc8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  15:35:07 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  15:35:07 Global memtable on-heap threshold is enabled at 128MB\nINFO  15:35:07 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:35:07 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-2wfc8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  15:35:07 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  15:35:07 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2wfc8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  15:35:07 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  15:35:07 Global memtable on-heap threshold is enabled at 128MB
    INFO  15:35:07 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 15:35:07 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4278/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420b45640>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-mwtjn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  16:27:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  16:27:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-mwtjn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  16:27:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  16:27:41 Global memtable on-heap threshold is enabled at 128MB\nINFO  16:27:41 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 16:27:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-mwtjn
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  16:27:40 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  16:27:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-mwtjn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  16:27:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  16:27:41 Global memtable on-heap threshold is enabled at 128MB
    INFO  16:27:41 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 16:27:41 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.147.5 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b9p9f] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ee2720 exit status 1 <nil> <nil> true [0xc4205b83e0 0xc4205b8400 0xc4205b8420] [0xc4205b83e0 0xc4205b8400 0xc4205b8420] [0xc4205b83f8 0xc4205b8418] [0xc37850 0xc37850] 0xc42135d980 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.147.5 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b9p9f] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ee2720 exit status 1 <nil> <nil> true [0xc4205b83e0 0xc4205b8400 0xc4205b8420] [0xc4205b83e0 0xc4205b8400 0xc4205b8420] [0xc4205b83f8 0xc4205b8418] [0xc37850 0xc37850] 0xc42135d980 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421a6c240>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 16:35:19.274  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0dl98 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 16:35:19.291  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 16:35:19.388  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 16:35:19 GMT 2017]; root of context hierarchy\n2017-03-19 16:35:21.076  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 16:35:21.094  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 16:35:21.730  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 16:35:21.868  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-19 16:35:21.869  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 16:35:21.882  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 16:35:21.919  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-19 16:35:21.919  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 16:35:21.919  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 16:35:22.309  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 16:35:23.332  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 16:35:23.597  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 16:35:23.600  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 16:35:23.626  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-19 16:35:23.627  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 16:35:23.662  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - a3004aeb-13ad-4d4e-a36f-d87d7f8756af this\n}\n\n2017-03-19 16:35:23.739  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-19 16:35:23.744  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.506 seconds (JVM running for 6.402)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 16:35:19.274  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0dl98 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 16:35:19.291  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 16:35:19.388  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 16:35:19 GMT 2017]; root of context hierarchy
    2017-03-19 16:35:21.076  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 16:35:21.094  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 16:35:21.730  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 16:35:21.868  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
    2017-03-19 16:35:21.869  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 16:35:21.882  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 16:35:21.919  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
    2017-03-19 16:35:21.919  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 16:35:21.919  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 16:35:22.309  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 16:35:23.332  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 16:35:23.597  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 16:35:23.600  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 16:35:23.626  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
    2017-03-19 16:35:23.627  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 16:35:23.662  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.16]:5701 - a3004aeb-13ad-4d4e-a36f-d87d7f8756af this
    }

    2017-03-19 16:35:23.739  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
    2017-03-19 16:35:23.744  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.506 seconds (JVM running for 6.402)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4279/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420e11060>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-np6m7\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  17:34:05 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  17:34:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-np6m7}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  17:34:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  17:34:05 Global memtable on-heap threshold is enabled at 128MB\nINFO  17:34:05 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:34:05 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-np6m7
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  17:34:05 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  17:34:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-np6m7}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  17:34:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  17:34:05 Global memtable on-heap threshold is enabled at 128MB
    INFO  17:34:05 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 17:34:05 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421be0470>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 17:37:02.673  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-mddk0 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 17:37:02.695  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 17:37:02.845  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 17:37:02 GMT 2017]; root of context hierarchy\n2017-03-19 17:37:04.810  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 17:37:04.836  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 17:37:05.522  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 17:37:05.656  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]\n2017-03-19 17:37:05.657  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 17:37:05.670  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 17:37:05.705  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701\n2017-03-19 17:37:05.706  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 17:37:05.706  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 17:37:06.078  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 17:37:06.977  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 17:37:07.256  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 17:37:07.262  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 17:37:07.283  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING\n2017-03-19 17:37:07.284  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 17:37:07.339  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.15]:5701 - 833c116c-b691-48a5-9a22-de95f7b23015 this\n}\n\n2017-03-19 17:37:07.416  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED\n2017-03-19 17:37:07.427  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.807 seconds (JVM running for 6.77)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 17:37:02.673  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-mddk0 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-19 17:37:02.695  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 17:37:02.845  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 17:37:02 GMT 2017]; root of context hierarchy
    2017-03-19 17:37:04.810  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 17:37:04.836  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 17:37:05.522  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 17:37:05.656  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]
    2017-03-19 17:37:05.657  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 17:37:05.670  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 17:37:05.705  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701
    2017-03-19 17:37:05.706  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 17:37:05.706  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 17:37:06.078  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 17:37:06.977  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 17:37:07.256  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 17:37:07.262  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 17:37:07.283  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING
    2017-03-19 17:37:07.284  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 17:37:07.339  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.15]:5701 - 833c116c-b691-48a5-9a22-de95f7b23015 this
    }

    2017-03-19 17:37:07.416  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED
    2017-03-19 17:37:07.427  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.807 seconds (JVM running for 6.77)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-3d4l3] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4216dbb00 exit status 1 <nil> <nil> true [0xc4202b4f00 0xc4202b4f20 0xc4202b4f58] [0xc4202b4f00 0xc4202b4f20 0xc4202b4f58] [0xc4202b4f18 0xc4202b4f40] [0xc37850 0xc37850] 0xc420ca4960 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-3d4l3] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4216dbb00 exit status 1 <nil> <nil> true [0xc4202b4f00 0xc4202b4f20 0xc4202b4f58] [0xc4202b4f00 0xc4202b4f20 0xc4202b4f58] [0xc4202b4f18 0xc4202b4f40] [0xc37850 0xc37850] 0xc420ca4960 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4281/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420c2e450>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.18\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.18\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.18\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.18\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-26nrz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  19:07:39 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  19:07:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.18; broadcast_rpc_address=10.180.1.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-26nrz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  19:07:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  19:07:40 Global memtable on-heap threshold is enabled at 128MB\nINFO  19:07:40 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 19:07:40 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.18
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.18
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.18
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.18
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-26nrz
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  19:07:39 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  19:07:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.18; broadcast_rpc_address=10.180.1.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-26nrz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  19:07:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  19:07:40 Global memtable on-heap threshold is enabled at 128MB
    INFO  19:07:40 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 19:07:40 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42132c030>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 18:46:52.171  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-2lsqg with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 18:46:52.178  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 18:46:52.259  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 18:46:52 GMT 2017]; root of context hierarchy\n2017-03-19 18:46:53.948  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 18:46:54.042  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 18:46:54.632  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 18:46:54.766  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.13]\n2017-03-19 18:46:54.767  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 18:46:54.786  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 18:46:54.837  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.13]:5701\n2017-03-19 18:46:54.837  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 18:46:54.837  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 18:46:55.163  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 18:46:55.982  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 18:46:56.288  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 18:46:56.303  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 18:46:56.340  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTING\n2017-03-19 18:46:56.341  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 18:46:56.365  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.13]:5701 - 7a105e70-7ac8-4a33-b0b3-c179fc820efe this\n}\n\n2017-03-19 18:46:56.431  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTED\n2017-03-19 18:46:56.434  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.226 seconds (JVM running for 6.13)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 18:46:52.171  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-2lsqg with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 18:46:52.178  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 18:46:52.259  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 18:46:52 GMT 2017]; root of context hierarchy
    2017-03-19 18:46:53.948  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 18:46:54.042  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 18:46:54.632  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 18:46:54.766  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.13]
    2017-03-19 18:46:54.767  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 18:46:54.786  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 18:46:54.837  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.13]:5701
    2017-03-19 18:46:54.837  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 18:46:54.837  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 18:46:55.163  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 18:46:55.982  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 18:46:56.288  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 18:46:56.303  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 18:46:56.340  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTING
    2017-03-19 18:46:56.341  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 18:46:56.365  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.13]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.13]:5701 - 7a105e70-7ac8-4a33-b0b3-c179fc820efe this
    }

    2017-03-19 18:46:56.431  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTED
    2017-03-19 18:46:56.434  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.226 seconds (JVM running for 6.13)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ct0b4] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4210bc030 exit status 1 <nil> <nil> true [0xc420034c60 0xc420034c80 0xc420034ca0] [0xc420034c60 0xc420034c80 0xc420034ca0] [0xc420034c70 0xc420034c98] [0xc37850 0xc37850] 0xc421081440 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.227.163 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ct0b4] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4210bc030 exit status 1 <nil> <nil> true [0xc420034c60 0xc420034c80 0xc420034ca0] [0xc420034c60 0xc420034c80 0xc420034ca0] [0xc420034c70 0xc420034c98] [0xc37850 0xc37850] 0xc421081440 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4282/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420f837a0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 19:48:12.451  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-209cz with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-19 19:48:12.459  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 19:48:12.539  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 19:48:12 GMT 2017]; root of context hierarchy\n2017-03-19 19:48:14.403  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 19:48:14.429  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 19:48:15.013  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 19:48:15.128  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.5]\n2017-03-19 19:48:15.129  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 19:48:15.141  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 19:48:15.174  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.5]:5701\n2017-03-19 19:48:15.175  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 19:48:15.175  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 19:48:15.510  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.5]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 19:48:16.377  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.5]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 19:48:16.650  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 19:48:16.664  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 19:48:16.674  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTING\n2017-03-19 19:48:16.676  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.5]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 19:48:16.732  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.5]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.5]:5701 - c1b13e1a-3a1b-42f0-a0bf-acbb6b0a5bad this\n}\n\n2017-03-19 19:48:16.846  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTED\n2017-03-19 19:48:16.858  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.42 seconds (JVM running for 6.316)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 19:48:12.451  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-209cz with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-19 19:48:12.459  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 19:48:12.539  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 19:48:12 GMT 2017]; root of context hierarchy
    2017-03-19 19:48:14.403  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 19:48:14.429  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 19:48:15.013  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 19:48:15.128  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.5]
    2017-03-19 19:48:15.129  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 19:48:15.141  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.5]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 19:48:15.174  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.5]:5701
    2017-03-19 19:48:15.175  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 19:48:15.175  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.5]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 19:48:15.510  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.5]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 19:48:16.377  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.5]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 19:48:16.650  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 19:48:16.664  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.5]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 19:48:16.674  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTING
    2017-03-19 19:48:16.676  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.5]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 19:48:16.732  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.5]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.5]:5701 - c1b13e1a-3a1b-42f0-a0bf-acbb6b0a5bad this
    }

    2017-03-19 19:48:16.846  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.5]:5701 [someGroup] [3.7.5] [10.180.3.5]:5701 is STARTED
    2017-03-19 19:48:16.858  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.42 seconds (JVM running for 6.316)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42155e680>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-s3s5k\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  20:03:06 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  20:03:06 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-s3s5k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  20:03:06 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  20:03:06 Global memtable on-heap threshold is enabled at 128MB\nINFO  20:03:06 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 20:03:06 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-s3s5k
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  20:03:06 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  20:03:06 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-s3s5k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  20:03:06 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  20:03:06 Global memtable on-heap threshold is enabled at 128MB
    INFO  20:03:06 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 20:03:06 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.79.60 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vfsq2] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420d5aea0 exit status 1 <nil> <nil> true [0xc420534008 0xc420534020 0xc420534058] [0xc420534008 0xc420534020 0xc420534058] [0xc420534018 0xc420534048] [0xc37850 0xc37850] 0xc4215603c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.79.60 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vfsq2] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420d5aea0 exit status 1 <nil> <nil> true [0xc420534008 0xc420534020 0xc420534058] [0xc420534008 0xc420534020 0xc420534058] [0xc420534018 0xc420534048] [0xc37850 0xc37850] 0xc4215603c0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4283/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4212c21b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 21:15:16.329  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-c0sbm with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 21:15:16.341  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 21:15:16.538  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 21:15:16 GMT 2017]; root of context hierarchy\n2017-03-19 21:15:17.813  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 21:15:17.836  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 21:15:18.447  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 21:15:18.538  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]\n2017-03-19 21:15:18.539  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 21:15:18.548  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 21:15:18.583  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701\n2017-03-19 21:15:18.583  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 21:15:18.583  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 21:15:18.875  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 21:15:19.627  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 21:15:19.881  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 21:15:19.888  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 21:15:19.914  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING\n2017-03-19 21:15:19.920  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 21:15:19.982  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.17]:5701 - 6d8d52d7-6900-4708-a937-f28510392440 this\n}\n\n2017-03-19 21:15:20.039  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED\n2017-03-19 21:15:20.040  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.587 seconds (JVM running for 5.517)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 21:15:16.329  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-c0sbm with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-19 21:15:16.341  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 21:15:16.538  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 21:15:16 GMT 2017]; root of context hierarchy
    2017-03-19 21:15:17.813  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 21:15:17.836  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 21:15:18.447  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 21:15:18.538  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]
    2017-03-19 21:15:18.539  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 21:15:18.548  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 21:15:18.583  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701
    2017-03-19 21:15:18.583  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 21:15:18.583  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 21:15:18.875  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 21:15:19.627  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 21:15:19.881  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 21:15:19.888  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 21:15:19.914  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING
    2017-03-19 21:15:19.920  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 21:15:19.982  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.17]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.17]:5701 - 6d8d52d7-6900-4708-a937-f28510392440 this
    }

    2017-03-19 21:15:20.039  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED
    2017-03-19 21:15:20.040  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.587 seconds (JVM running for 5.517)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ht21q] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ecf6e0 exit status 1 <nil> <nil> true [0xc42021dd10 0xc42021dd28 0xc42021dd40] [0xc42021dd10 0xc42021dd28 0xc42021dd40] [0xc42021dd20 0xc42021dd38] [0xc37850 0xc37850] 0xc420ad5740 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ht21q] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ecf6e0 exit status 1 <nil> <nil> true [0xc42021dd10 0xc42021dd28 0xc42021dd40] [0xc42021dd10 0xc42021dd28 0xc42021dd40] [0xc42021dd20 0xc42021dd38] [0xc37850 0xc37850] 0xc420ad5740 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420d05000>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-bfkx2\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  21:05:09 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  21:05:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bfkx2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  21:05:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  21:05:09 Global memtable on-heap threshold is enabled at 128MB\nINFO  21:05:09 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 21:05:09 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-bfkx2
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  21:05:09 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  21:05:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bfkx2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  21:05:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  21:05:09 Global memtable on-heap threshold is enabled at 128MB
    INFO  21:05:09 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 21:05:09 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4284/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42085ef10>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 22:02:47.145  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-j5v8s with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 22:02:47.153  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 22:02:47.258  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 22:02:47 GMT 2017]; root of context hierarchy\n2017-03-19 22:02:48.908  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 22:02:48.929  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 22:02:49.579  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 22:02:49.712  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.10]\n2017-03-19 22:02:49.713  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 22:02:49.727  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 22:02:49.762  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.10]:5701\n2017-03-19 22:02:49.763  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 22:02:49.763  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 22:02:50.234  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.10]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 22:02:51.205  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 22:02:51.509  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 22:02:51.516  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 22:02:51.548  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTING\n2017-03-19 22:02:51.554  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 22:02:51.603  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.10]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.10]:5701 - a4abb578-77b0-42bd-a19f-292162b2c52a this\n}\n\n2017-03-19 22:02:51.688  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTED\n2017-03-19 22:02:51.695  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.663 seconds (JVM running for 6.554)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 22:02:47.145  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-j5v8s with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-19 22:02:47.153  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 22:02:47.258  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 22:02:47 GMT 2017]; root of context hierarchy
    2017-03-19 22:02:48.908  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 22:02:48.929  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 22:02:49.579  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 22:02:49.712  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.10]
    2017-03-19 22:02:49.713  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 22:02:49.727  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 22:02:49.762  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.10]:5701
    2017-03-19 22:02:49.763  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 22:02:49.763  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 22:02:50.234  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.10]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 22:02:51.205  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 22:02:51.509  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 22:02:51.516  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 22:02:51.548  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTING
    2017-03-19 22:02:51.554  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 22:02:51.603  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.10]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.10]:5701 - a4abb578-77b0-42bd-a19f-292162b2c52a this
    }

    2017-03-19 22:02:51.688  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.10]:5701 [someGroup] [3.7.5] [10.180.1.10]:5701 is STARTED
    2017-03-19 22:02:51.695  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.663 seconds (JVM running for 6.554)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42141c0b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0q183\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  22:17:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  22:17:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0q183}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  22:17:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  22:17:40 Global memtable on-heap threshold is enabled at 128MB\nINFO  22:17:40 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 22:17:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0q183
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  22:17:40 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  22:17:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0q183}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  22:17:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  22:17:40 Global memtable on-heap threshold is enabled at 128MB
    INFO  22:17:40 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 22:17:41 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.29.172 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jmnmm] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4216c73b0 exit status 1 <nil> <nil> true [0xc42113a160 0xc42113a178 0xc42113a190] [0xc42113a160 0xc42113a178 0xc42113a190] [0xc42113a170 0xc42113a188] [0xc37850 0xc37850] 0xc420f4e180 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.29.172 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jmnmm] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4216c73b0 exit status 1 <nil> <nil> true [0xc42113a160 0xc42113a178 0xc42113a190] [0xc42113a160 0xc42113a178 0xc42113a190] [0xc42113a170 0xc42113a188] [0xc37850 0xc37850] 0xc420f4e180 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4285/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.180.50 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-rtnzt] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420df7b00 exit status 1 <nil> <nil> true [0xc42032a648 0xc42032a660 0xc42032a678] [0xc42032a648 0xc42032a660 0xc42032a678] [0xc42032a658 0xc42032a670] [0xc37850 0xc37850] 0xc4211a3620 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.180.50 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-rtnzt] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420df7b00 exit status 1 <nil> <nil> true [0xc42032a648 0xc42032a660 0xc42032a678] [0xc42032a648 0xc42032a660 0xc42032a678] [0xc42032a658 0xc42032a670] [0xc37850 0xc37850] 0xc4211a3620 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421a7e200>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.19\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.19\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.19\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.19\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3m1r8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  23:17:07 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  23:17:07 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.19; broadcast_rpc_address=10.180.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3m1r8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  23:17:07 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  23:17:07 Global memtable on-heap threshold is enabled at 128MB\nINFO  23:17:07 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 23:17:07 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.19
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.19
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.19
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.19
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3m1r8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  23:17:07 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  23:17:07 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.19; broadcast_rpc_address=10.180.3.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3m1r8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  23:17:07 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  23:17:07 Global memtable on-heap threshold is enabled at 128MB
    INFO  23:17:07 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 23:17:07 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420cd25d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-19 23:21:50.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-nst2q with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-19 23:21:50.553  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-19 23:21:50.725  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 23:21:50 GMT 2017]; root of context hierarchy\n2017-03-19 23:21:52.796  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-19 23:21:52.818  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-19 23:21:53.631  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-19 23:21:53.751  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.21]\n2017-03-19 23:21:53.751  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-19 23:21:53.764  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-19 23:21:53.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.21]:5701\n2017-03-19 23:21:53.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-19 23:21:53.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-19 23:21:54.163  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.21]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-19 23:21:55.073  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-19 23:21:55.415  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-19 23:21:55.420  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-19 23:21:55.429  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTING\n2017-03-19 23:21:55.433  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-19 23:21:55.494  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.21]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.21]:5701 - 04ee42b4-60eb-4709-947e-03f180dbf7f8 this\n}\n\n2017-03-19 23:21:55.607  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTED\n2017-03-19 23:21:55.610  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.28 seconds (JVM running for 7.266)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-19 23:21:50.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-nst2q with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-19 23:21:50.553  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-19 23:21:50.725  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sun Mar 19 23:21:50 GMT 2017]; root of context hierarchy
    2017-03-19 23:21:52.796  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-19 23:21:52.818  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-19 23:21:53.631  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-19 23:21:53.751  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.21]
    2017-03-19 23:21:53.751  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-19 23:21:53.764  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-19 23:21:53.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.21]:5701
    2017-03-19 23:21:53.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-19 23:21:53.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-19 23:21:54.163  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.21]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-19 23:21:55.073  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-19 23:21:55.415  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-19 23:21:55.420  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-19 23:21:55.429  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTING
    2017-03-19 23:21:55.433  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-19 23:21:55.494  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.21]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.21]:5701 - 04ee42b4-60eb-4709-947e-03f180dbf7f8 this
    }

    2017-03-19 23:21:55.607  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.21]:5701 [someGroup] [3.7.5] [10.180.3.21]:5701 is STARTED
    2017-03-19 23:21:55.610  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 6.28 seconds (JVM running for 7.266)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4287/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420ef4130>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-19zhj\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  01:24:10 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  01:24:10 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-19zhj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  01:24:10 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  01:24:10 Global memtable on-heap threshold is enabled at 128MB\nINFO  01:24:10 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:24:10 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-19zhj
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  01:24:10 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  01:24:10 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-19zhj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  01:24:10 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  01:24:10 Global memtable on-heap threshold is enabled at 128MB
    INFO  01:24:10 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 01:24:10 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420cd6230>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 01:28:48.745  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-cxmp5 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 01:28:48.771  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 01:28:48.927  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@69663380: startup date [Mon Mar 20 01:28:48 GMT 2017]; root of context hierarchy\n2017-03-20 01:28:50.607  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 01:28:50.634  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 01:28:51.332  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 01:28:51.445  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.16]\n2017-03-20 01:28:51.446  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 01:28:51.459  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 01:28:51.492  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.16]:5701\n2017-03-20 01:28:51.493  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 01:28:51.493  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 01:28:51.804  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 01:28:52.645  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 01:28:52.987  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 01:28:52.993  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 01:28:53.002  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTING\n2017-03-20 01:28:53.007  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 01:28:53.030  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.16]:5701 - d74ab6e8-1192-4231-97a5-866bfe4405e7 this\n}\n\n2017-03-20 01:28:53.116  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTED\n2017-03-20 01:28:53.118  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.458 seconds (JVM running for 6.6)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 01:28:48.745  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-cxmp5 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-20 01:28:48.771  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 01:28:48.927  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@69663380: startup date [Mon Mar 20 01:28:48 GMT 2017]; root of context hierarchy
    2017-03-20 01:28:50.607  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 01:28:50.634  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 01:28:51.332  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 01:28:51.445  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.16]
    2017-03-20 01:28:51.446  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 01:28:51.459  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 01:28:51.492  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.16]:5701
    2017-03-20 01:28:51.493  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 01:28:51.493  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 01:28:51.804  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 01:28:52.645  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 01:28:52.987  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 01:28:52.993  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 01:28:53.002  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTING
    2017-03-20 01:28:53.007  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 01:28:53.030  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.16]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.16]:5701 - d74ab6e8-1192-4231-97a5-866bfe4405e7 this
    }

    2017-03-20 01:28:53.116  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTED
    2017-03-20 01:28:53.118  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.458 seconds (JVM running for 6.6)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.180.50 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8nlkg] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42204f8c0 exit status 1 <nil> <nil> true [0xc420531478 0xc420531490 0xc4205314b0] [0xc420531478 0xc420531490 0xc4205314b0] [0xc420531488 0xc4205314a0] [0xc37850 0xc37850] 0xc4214b9f80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.180.50 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8nlkg] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42204f8c0 exit status 1 <nil> <nil> true [0xc420531478 0xc420531490 0xc4205314b0] [0xc420531478 0xc420531490 0xc4205314b0] [0xc420531488 0xc4205314a0] [0xc37850 0xc37850] 0xc4214b9f80 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4288/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42214fda0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 02:38:01.926  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-qlmtq with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 02:38:01.950  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 02:38:02.050  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 02:38:02 GMT 2017]; root of context hierarchy\n2017-03-20 02:38:03.619  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 02:38:03.650  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 02:38:04.224  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 02:38:04.358  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.18]\n2017-03-20 02:38:04.358  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 02:38:04.370  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 02:38:04.420  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.18]:5701\n2017-03-20 02:38:04.420  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 02:38:04.420  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 02:38:04.771  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 02:38:05.707  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 02:38:05.998  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 02:38:06.001  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 02:38:06.016  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.18]:5701 [someGroup] [3.7.5] [10.180.2.18]:5701 is STARTING\n2017-03-20 02:38:06.021  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 02:38:06.070  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.18]:5701 - 94f7f5e8-2c04-4198-85b7-facb260dc1b7 this\n}\n\n2017-03-20 02:38:06.166  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.18]:5701 [someGroup] [3.7.5] [10.180.2.18]:5701 is STARTED\n2017-03-20 02:38:06.181  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.209 seconds (JVM running for 6.158)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 02:38:01.926  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-qlmtq with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-20 02:38:01.950  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 02:38:02.050  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 02:38:02 GMT 2017]; root of context hierarchy
    2017-03-20 02:38:03.619  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 02:38:03.650  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 02:38:04.224  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 02:38:04.358  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.18]
    2017-03-20 02:38:04.358  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 02:38:04.370  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 02:38:04.420  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.18]:5701
    2017-03-20 02:38:04.420  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 02:38:04.420  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 02:38:04.771  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 02:38:05.707  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 02:38:05.998  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 02:38:06.001  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 02:38:06.016  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.18]:5701 [someGroup] [3.7.5] [10.180.2.18]:5701 is STARTING
    2017-03-20 02:38:06.021  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 02:38:06.070  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.18]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.18]:5701 - 94f7f5e8-2c04-4198-85b7-facb260dc1b7 this
    }

    2017-03-20 02:38:06.166  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.18]:5701 [someGroup] [3.7.5] [10.180.2.18]:5701 is STARTED
    2017-03-20 02:38:06.181  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.209 seconds (JVM running for 6.158)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.203.146 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8xqr1] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e636b0 exit status 1 <nil> <nil> true [0xc420038320 0xc420038338 0xc420038358] [0xc420038320 0xc420038338 0xc420038358] [0xc420038330 0xc420038348] [0xc37850 0xc37850] 0xc420a58f00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.203.146 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8xqr1] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420e636b0 exit status 1 <nil> <nil> true [0xc420038320 0xc420038338 0xc420038358] [0xc420038320 0xc420038338 0xc420038358] [0xc420038330 0xc420038348] [0xc37850 0xc37850] 0xc420a58f00 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42120e620>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-ktdt8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  02:32:24 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  02:32:25 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ktdt8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  02:32:25 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  02:32:25 Global memtable on-heap threshold is enabled at 128MB\nINFO  02:32:25 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 02:32:25 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-ktdt8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  02:32:24 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  02:32:25 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ktdt8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  02:32:25 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  02:32:25 Global memtable on-heap threshold is enabled at 128MB
    INFO  02:32:25 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 02:32:25 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4290/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420ec5470>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-dzsq8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  04:26:30 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  04:26:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dzsq8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  04:26:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  04:26:30 Global memtable on-heap threshold is enabled at 128MB\nINFO  04:26:30 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 04:26:30 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-dzsq8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  04:26:30 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  04:26:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dzsq8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  04:26:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  04:26:30 Global memtable on-heap threshold is enabled at 128MB
    INFO  04:26:30 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 04:26:30 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l93fc] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421f96600 exit status 1 <nil> <nil> true [0xc420b122f8 0xc420b12360 0xc420b12380] [0xc420b122f8 0xc420b12360 0xc420b12380] [0xc420b12340 0xc420b12378] [0xc37850 0xc37850] 0xc420839f20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-l93fc] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421f96600 exit status 1 <nil> <nil> true [0xc420b122f8 0xc420b12360 0xc420b12380] [0xc420b122f8 0xc420b12360 0xc420b12380] [0xc420b12340 0xc420b12378] [0xc37850 0xc37850] 0xc420839f20 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc422032830>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 04:43:55.529  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-05b2n with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 04:43:55.544  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 04:43:55.630  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 04:43:55 GMT 2017]; root of context hierarchy\n2017-03-20 04:43:57.398  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 04:43:57.443  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 04:43:58.144  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 04:43:58.281  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.21]\n2017-03-20 04:43:58.282  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 04:43:58.296  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 04:43:58.330  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.21]:5701\n2017-03-20 04:43:58.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 04:43:58.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 04:43:58.653  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.21]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 04:43:59.506  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 04:43:59.815  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 04:43:59.823  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 04:43:59.832  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTING\n2017-03-20 04:43:59.834  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 04:43:59.856  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.21]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.21]:5701 - 74ffc379-4632-4632-a086-c3fbcc63db50 this\n}\n\n2017-03-20 04:43:59.924  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTED\n2017-03-20 04:43:59.935  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.451 seconds (JVM running for 6.435)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 04:43:55.529  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-05b2n with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-20 04:43:55.544  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 04:43:55.630  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 04:43:55 GMT 2017]; root of context hierarchy
    2017-03-20 04:43:57.398  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 04:43:57.443  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 04:43:58.144  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 04:43:58.281  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.21]
    2017-03-20 04:43:58.282  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 04:43:58.296  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.21]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 04:43:58.330  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.21]:5701
    2017-03-20 04:43:58.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 04:43:58.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.21]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 04:43:58.653  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.21]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 04:43:59.506  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.21]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 04:43:59.815  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 04:43:59.823  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.21]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 04:43:59.832  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTING
    2017-03-20 04:43:59.834  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.21]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 04:43:59.856  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.21]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.21]:5701 - 74ffc379-4632-4632-a086-c3fbcc63db50 this
    }

    2017-03-20 04:43:59.924  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.21]:5701 [someGroup] [3.7.5] [10.180.1.21]:5701 is STARTED
    2017-03-20 04:43:59.935  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.451 seconds (JVM running for 6.435)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4291/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42120e080>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-34mgv\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:41:20 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:41:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-34mgv}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:41:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:41:20 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:41:20 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:41:21 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-34mgv
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  05:41:20 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:41:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-34mgv}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:41:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:41:20 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:41:20 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:41:21 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42109d0c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 05:46:28.921  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ld1l3 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 05:46:28.929  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 05:46:29.031  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 05:46:29 GMT 2017]; root of context hierarchy\n2017-03-20 05:46:30.961  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 05:46:30.988  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 05:46:31.724  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 05:46:31.854  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.13]\n2017-03-20 05:46:31.855  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 05:46:31.868  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 05:46:31.901  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.13]:5701\n2017-03-20 05:46:31.901  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 05:46:31.901  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 05:46:32.252  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 05:46:33.250  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 05:46:33.526  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 05:46:33.528  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 05:46:33.544  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTING\n2017-03-20 05:46:33.548  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 05:46:33.586  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.13]:5701 - 65221253-6ee1-453e-bbf8-1ae06b8252b8 this\n}\n\n2017-03-20 05:46:33.665  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTED\n2017-03-20 05:46:33.670  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.78 seconds (JVM running for 6.703)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 05:46:28.921  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ld1l3 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-20 05:46:28.929  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 05:46:29.031  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 05:46:29 GMT 2017]; root of context hierarchy
    2017-03-20 05:46:30.961  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 05:46:30.988  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 05:46:31.724  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 05:46:31.854  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.13]
    2017-03-20 05:46:31.855  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 05:46:31.868  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 05:46:31.901  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.13]:5701
    2017-03-20 05:46:31.901  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 05:46:31.901  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 05:46:32.252  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 05:46:33.250  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 05:46:33.526  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 05:46:33.528  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 05:46:33.544  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTING
    2017-03-20 05:46:33.548  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 05:46:33.586  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.13]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.13]:5701 - 65221253-6ee1-453e-bbf8-1ae06b8252b8 this
    }

    2017-03-20 05:46:33.665  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.13]:5701 [someGroup] [3.7.5] [10.180.3.13]:5701 is STARTED
    2017-03-20 05:46:33.670  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.78 seconds (JVM running for 6.703)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0g72b] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420d4f200 exit status 1 <nil> <nil> true [0xc420e52ba8 0xc420e52bd8 0xc420e52bf0] [0xc420e52ba8 0xc420e52bd8 0xc420e52bf0] [0xc420e52bd0 0xc420e52be8] [0xc37850 0xc37850] 0xc421cbbc80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0g72b] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420d4f200 exit status 1 <nil> <nil> true [0xc420e52ba8 0xc420e52bd8 0xc420e52bf0] [0xc420e52ba8 0xc420e52bd8 0xc420e52bf0] [0xc420e52bd0 0xc420e52be8] [0xc37850 0xc37850] 0xc421cbbc80 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4292/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421202280>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-gkp3f\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:41:08 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:41:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gkp3f}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:41:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:41:09 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:41:09 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:41:09 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-gkp3f
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  06:41:08 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:41:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gkp3f}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:41:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:41:09 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:41:09 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:41:09 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.172.103 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v2l5n] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e07890 exit status 1 <nil> <nil> true [0xc420036620 0xc420036648 0xc420036668] [0xc420036620 0xc420036648 0xc420036668] [0xc420036638 0xc420036660] [0xc37850 0xc37850] 0xc4213cf980 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.172.103 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v2l5n] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420e07890 exit status 1 <nil> <nil> true [0xc420036620 0xc420036648 0xc420036668] [0xc420036620 0xc420036648 0xc420036668] [0xc420036638 0xc420036660] [0xc37850 0xc37850] 0xc4213cf980 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4221dea60>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 06:51:44.822  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-s0k2z with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-20 06:51:44.831  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 06:51:44.970  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 06:51:44 GMT 2017]; root of context hierarchy\n2017-03-20 06:51:46.730  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 06:51:46.755  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 06:51:47.422  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 06:51:47.562  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.27]\n2017-03-20 06:51:47.562  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 06:51:47.575  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.27]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 06:51:47.611  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.27]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.27]:5701\n2017-03-20 06:51:47.611  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.27]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 06:51:47.611  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.27]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 06:51:47.989  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.27]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 06:51:48.879  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.27]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 06:51:49.170  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.27]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 06:51:49.178  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.27]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 06:51:49.188  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.27]:5701 [someGroup] [3.7.5] [10.180.1.27]:5701 is STARTING\n2017-03-20 06:51:49.191  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.27]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 06:51:49.215  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.27]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.27]:5701 - a9e94fb0-0804-4737-8d68-e04b9e3dc5f8 this\n}\n\n2017-03-20 06:51:49.286  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.27]:5701 [someGroup] [3.7.5] [10.180.1.27]:5701 is STARTED\n2017-03-20 06:51:49.298  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.511 seconds (JVM running for 6.554)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 06:51:44.822  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-s0k2z with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-20 06:51:44.831  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 06:51:44.970  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 06:51:44 GMT 2017]; root of context hierarchy
    2017-03-20 06:51:46.730  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 06:51:46.755  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 06:51:47.422  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 06:51:47.562  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.27]
    2017-03-20 06:51:47.562  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 06:51:47.575  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.27]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 06:51:47.611  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.27]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.27]:5701
    2017-03-20 06:51:47.611  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.27]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 06:51:47.611  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.27]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 06:51:47.989  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.27]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 06:51:48.879  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.27]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 06:51:49.170  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.27]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 06:51:49.178  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.27]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 06:51:49.188  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.27]:5701 [someGroup] [3.7.5] [10.180.1.27]:5701 is STARTING
    2017-03-20 06:51:49.191  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.27]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 06:51:49.215  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.27]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.27]:5701 - a9e94fb0-0804-4737-8d68-e04b9e3dc5f8 this
    }

    2017-03-20 06:51:49.286  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.27]:5701 [someGroup] [3.7.5] [10.180.1.27]:5701 is STARTED
    2017-03-20 06:51:49.298  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.511 seconds (JVM running for 6.554)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4293/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421c82650>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3pq58\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  07:38:52 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  07:38:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3pq58}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  07:38:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  07:38:52 Global memtable on-heap threshold is enabled at 128MB\nINFO  07:38:52 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 07:38:53 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3pq58
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  07:38:52 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  07:38:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3pq58}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  07:38:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  07:38:52 Global memtable on-heap threshold is enabled at 128MB
    INFO  07:38:52 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 07:38:53 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] ClusterDns [Feature:Example] should create pod that uses dns {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:153
Expected error:
    <*errors.errorString | 0xc4203fc790>: {
        s: "timed out waiting for the condition",
    }
    timed out waiting for the condition
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/example_cluster_dns.go:145

Issues about this test specifically: #36279

Failed: [k8s.io] [Feature:Example] [k8s.io] Downward API should create a pod that prints his name and namespace {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:120
Mar 20 01:12:53.802: All nodes should be ready after test, Not ready nodes: ", bootstrap-e2e-minion-group-h671"
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:335

Issues about this test specifically: #31539 #31888 #35261

Failed: [k8s.io] [Feature:Example] [k8s.io] Storm should create and stop Zookeeper, Nimbus and Storm worker servers {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:120
Mar 20 01:18:28.250: All nodes should be ready after test, Not ready nodes: ", bootstrap-e2e-minion-group-h671"
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:335

Issues about this test specifically: #29225 #33106 #38047

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420d34c40>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 08:19:05.984  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-dkbqz with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 08:19:05.991  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 08:19:06.127  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 08:19:06 GMT 2017]; root of context hierarchy\n2017-03-20 08:19:08.031  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 08:19:08.051  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 08:19:08.809  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 08:19:08.916  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]\n2017-03-20 08:19:08.917  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 08:19:08.928  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 08:19:08.961  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701\n2017-03-20 08:19:08.961  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 08:19:08.961  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 08:19:09.310  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 08:19:10.228  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 08:19:10.527  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 08:19:10.534  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 08:19:10.542  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING\n2017-03-20 08:19:10.553  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 08:19:10.596  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.17]:5701 - adad1f87-1828-417c-8c41-2f85272eb2a7 this\n}\n\n2017-03-20 08:19:10.661  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED\n2017-03-20 08:19:10.670  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.743 seconds (JVM running for 6.572)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 08:19:05.984  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-dkbqz with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-20 08:19:05.991  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 08:19:06.127  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 08:19:06 GMT 2017]; root of context hierarchy
    2017-03-20 08:19:08.031  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 08:19:08.051  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 08:19:08.809  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 08:19:08.916  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.17]
    2017-03-20 08:19:08.917  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 08:19:08.928  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 08:19:08.961  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.17]:5701
    2017-03-20 08:19:08.961  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 08:19:08.961  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 08:19:09.310  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 08:19:10.228  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 08:19:10.527  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 08:19:10.534  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 08:19:10.542  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTING
    2017-03-20 08:19:10.553  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 08:19:10.596  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.17]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.17]:5701 - adad1f87-1828-417c-8c41-2f85272eb2a7 this
    }

    2017-03-20 08:19:10.661  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.17]:5701 [someGroup] [3.7.5] [10.180.2.17]:5701 is STARTED
    2017-03-20 08:19:10.670  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.743 seconds (JVM running for 6.572)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.172.103 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tgzd1] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420dd7d40 exit status 1 <nil> <nil> true [0xc420038738 0xc420038750 0xc420038768] [0xc420038738 0xc420038750 0xc420038768] [0xc420038748 0xc420038760] [0xc37850 0xc37850] 0xc421129e00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.172.103 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tgzd1] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420dd7d40 exit status 1 <nil> <nil> true [0xc420038738 0xc420038750 0xc420038768] [0xc420038738 0xc420038750 0xc420038768] [0xc420038748 0xc420038760] [0xc37850 0xc37850] 0xc421129e00 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4294/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420c3cbf0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-73g33\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  09:15:51 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  09:15:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-73g33}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  09:15:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  09:15:52 Global memtable on-heap threshold is enabled at 128MB\nINFO  09:15:52 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:15:52 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-73g33
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  09:15:51 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  09:15:52 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-73g33}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  09:15:52 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  09:15:52 Global memtable on-heap threshold is enabled at 128MB
    INFO  09:15:52 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 09:15:52 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7wwb9] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4215ac510 exit status 1 <nil> <nil> true [0xc420212bb0 0xc420212bf8 0xc420212c40] [0xc420212bb0 0xc420212bf8 0xc420212c40] [0xc420212bf0 0xc420212c20] [0xc37850 0xc37850] 0xc421575e60 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7wwb9] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4215ac510 exit status 1 <nil> <nil> true [0xc420212bb0 0xc420212bf8 0xc420212c40] [0xc420212bb0 0xc420212bf8 0xc420212c40] [0xc420212bf0 0xc420212c20] [0xc37850 0xc37850] 0xc421575e60 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc422027380>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 09:27:10.397  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-vvlv4 with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-20 09:27:10.405  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 09:27:10.544  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 09:27:10 GMT 2017]; root of context hierarchy\n2017-03-20 09:27:12.171  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 09:27:12.198  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 09:27:12.933  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 09:27:13.051  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-20 09:27:13.052  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 09:27:13.065  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 09:27:13.096  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-20 09:27:13.096  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 09:27:13.097  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 09:27:13.496  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 09:27:14.517  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 09:27:14.797  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 09:27:14.802  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 09:27:14.810  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-20 09:27:14.811  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 09:27:14.848  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - 5c3c1488-da90-424b-aa9b-cfad2ed80326 this\n}\n\n2017-03-20 09:27:14.930  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-20 09:27:14.938  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.594 seconds (JVM running for 6.475)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 09:27:10.397  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-vvlv4 with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-20 09:27:10.405  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 09:27:10.544  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 09:27:10 GMT 2017]; root of context hierarchy
    2017-03-20 09:27:12.171  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 09:27:12.198  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 09:27:12.933  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 09:27:13.051  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
    2017-03-20 09:27:13.052  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 09:27:13.065  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 09:27:13.096  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
    2017-03-20 09:27:13.096  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 09:27:13.097  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 09:27:13.496  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 09:27:14.517  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 09:27:14.797  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 09:27:14.802  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 09:27:14.810  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
    2017-03-20 09:27:14.811  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 09:27:14.848  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.16]:5701 - 5c3c1488-da90-424b-aa9b-cfad2ed80326 this
    }

    2017-03-20 09:27:14.930  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
    2017-03-20 09:27:14.938  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.594 seconds (JVM running for 6.475)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4295/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-z7prq] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420deb7d0 exit status 1 <nil> <nil> true [0xc420598b48 0xc420598b60 0xc420598b78] [0xc420598b48 0xc420598b60 0xc420598b78] [0xc420598b58 0xc420598b70] [0xc37850 0xc37850] 0xc421338ba0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-z7prq] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420deb7d0 exit status 1 <nil> <nil> true [0xc420598b48 0xc420598b60 0xc420598b78] [0xc420598b48 0xc420598b60 0xc420598b78] [0xc420598b58 0xc420598b70] [0xc37850 0xc37850] 0xc421338ba0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420bce460>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 10:14:44.321  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-kn5gw with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 10:14:44.327  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 10:14:44.415  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 10:14:44 GMT 2017]; root of context hierarchy\n2017-03-20 10:14:45.912  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 10:14:45.927  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 10:14:46.434  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 10:14:46.527  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-20 10:14:46.527  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 10:14:46.538  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 10:14:46.564  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-20 10:14:46.564  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 10:14:46.564  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 10:14:46.852  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 10:14:47.664  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 10:14:47.907  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 10:14:47.917  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 10:14:47.930  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-20 10:14:47.931  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 10:14:47.955  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - ecebabe7-5fc0-42d1-bc64-02f3073e6d42 this\n}\n\n2017-03-20 10:14:48.015  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-20 10:14:48.017  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.513 seconds (JVM running for 5.269)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 10:14:44.321  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-kn5gw with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-20 10:14:44.327  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 10:14:44.415  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 10:14:44 GMT 2017]; root of context hierarchy
    2017-03-20 10:14:45.912  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 10:14:45.927  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 10:14:46.434  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 10:14:46.527  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
    2017-03-20 10:14:46.527  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 10:14:46.538  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 10:14:46.564  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
    2017-03-20 10:14:46.564  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 10:14:46.564  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 10:14:46.852  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 10:14:47.664  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 10:14:47.907  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 10:14:47.917  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 10:14:47.930  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
    2017-03-20 10:14:47.931  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 10:14:47.955  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.16]:5701 - ecebabe7-5fc0-42d1-bc64-02f3073e6d42 this
    }

    2017-03-20 10:14:48.015  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
    2017-03-20 10:14:48.017  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.513 seconds (JVM running for 5.269)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4205a7510>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-25gj6\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  10:34:22 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  10:34:22 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-25gj6}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  10:34:22 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  10:34:23 Global memtable on-heap threshold is enabled at 128MB\nINFO  10:34:23 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 10:34:23 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-25gj6
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  10:34:22 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  10:34:22 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-25gj6}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  10:34:22 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  10:34:23 Global memtable on-heap threshold is enabled at 128MB
    INFO  10:34:23 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 10:34:23 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4296/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42126b770>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 11:08:58.803  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-w2q8s with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 11:08:58.813  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 11:08:58.893  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 11:08:58 GMT 2017]; root of context hierarchy\n2017-03-20 11:09:00.378  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 11:09:00.395  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 11:09:00.945  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 11:09:01.048  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.4]\n2017-03-20 11:09:01.048  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 11:09:01.060  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 11:09:01.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.4]:5701\n2017-03-20 11:09:01.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 11:09:01.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 11:09:01.450  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.4]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 11:09:02.301  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 11:09:02.567  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 11:09:02.575  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 11:09:02.597  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTING\n2017-03-20 11:09:02.603  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 11:09:02.627  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.4]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.4]:5701 - 6b8c96ab-d1a4-4578-b167-12921d994a46 this\n}\n\n2017-03-20 11:09:02.693  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTED\n2017-03-20 11:09:02.699  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.797 seconds (JVM running for 5.571)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 11:08:58.803  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-w2q8s with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-20 11:08:58.813  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 11:08:58.893  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 11:08:58 GMT 2017]; root of context hierarchy
    2017-03-20 11:09:00.378  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 11:09:00.395  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 11:09:00.945  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 11:09:01.048  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.4]
    2017-03-20 11:09:01.048  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 11:09:01.060  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 11:09:01.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.4]:5701
    2017-03-20 11:09:01.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 11:09:01.089  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 11:09:01.450  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.4]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 11:09:02.301  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 11:09:02.567  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 11:09:02.575  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 11:09:02.597  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTING
    2017-03-20 11:09:02.603  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 11:09:02.627  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.4]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.4]:5701 - 6b8c96ab-d1a4-4578-b167-12921d994a46 this
    }

    2017-03-20 11:09:02.693  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTED
    2017-03-20 11:09:02.699  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.797 seconds (JVM running for 5.571)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421ed2280>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.5\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.5\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.5\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.5\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-06l5k\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:23:49 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:23:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.5; broadcast_rpc_address=10.180.3.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-06l5k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:23:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:23:50 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:23:50 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:23:50 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.5
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.5
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.5
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.5
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-06l5k
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  11:23:49 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:23:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.5; broadcast_rpc_address=10.180.3.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-06l5k}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:23:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:23:50 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:23:50 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 11:23:50 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-szbhx] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4209ef890 exit status 1 <nil> <nil> true [0xc4201c4348 0xc4201c4378 0xc4201c43d0] [0xc4201c4348 0xc4201c4378 0xc4201c43d0] [0xc4201c4368 0xc4201c43b0] [0xc37850 0xc37850] 0xc420bb85a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-szbhx] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4209ef890 exit status 1 <nil> <nil> true [0xc4201c4348 0xc4201c4378 0xc4201c43d0] [0xc4201c4348 0xc4201c4378 0xc4201c43d0] [0xc4201c4368 0xc4201c43b0] [0xc37850 0xc37850] 0xc420bb85a0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4297/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4212ea410>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 12:13:34.051  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ht2mq with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 12:13:34.071  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 12:13:34.147  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 12:13:34 GMT 2017]; root of context hierarchy\n2017-03-20 12:13:35.945  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 12:13:35.968  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 12:13:36.598  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 12:13:36.706  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]\n2017-03-20 12:13:36.706  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 12:13:36.717  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 12:13:36.747  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-20 12:13:36.747  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 12:13:36.747  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 12:13:37.089  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 12:13:37.939  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 12:13:38.204  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 12:13:38.205  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 12:13:38.224  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-20 12:13:38.226  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 12:13:38.277  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 38f8e5f6-313a-4b87-9b80-94980208a283 this\n}\n\n2017-03-20 12:13:38.346  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-20 12:13:38.350  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.304 seconds (JVM running for 6.141)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 12:13:34.051  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ht2mq with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-20 12:13:34.071  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 12:13:34.147  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 12:13:34 GMT 2017]; root of context hierarchy
    2017-03-20 12:13:35.945  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 12:13:35.968  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 12:13:36.598  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 12:13:36.706  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]
    2017-03-20 12:13:36.706  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 12:13:36.717  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 12:13:36.747  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
    2017-03-20 12:13:36.747  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 12:13:36.747  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 12:13:37.089  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 12:13:37.939  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 12:13:38.204  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 12:13:38.205  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 12:13:38.224  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
    2017-03-20 12:13:38.226  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 12:13:38.277  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.6]:5701 - 38f8e5f6-313a-4b87-9b80-94980208a283 this
    }

    2017-03-20 12:13:38.346  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
    2017-03-20 12:13:38.350  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.304 seconds (JVM running for 6.141)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.26.222 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8v9xd] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421b64f30 exit status 1 <nil> <nil> true [0xc420038990 0xc4200389d8 0xc420038a10] [0xc420038990 0xc4200389d8 0xc420038a10] [0xc4200389a8 0xc420038a08] [0xc37850 0xc37850] 0xc420c5d0e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.26.222 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-8v9xd] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421b64f30 exit status 1 <nil> <nil> true [0xc420038990 0xc4200389d8 0xc420038a10] [0xc420038990 0xc4200389d8 0xc420038a10] [0xc4200389a8 0xc420038a08] [0xc37850 0xc37850] 0xc420c5d0e0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421fe0470>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-ts1nz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  12:40:58 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  12:40:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ts1nz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  12:40:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  12:40:59 Global memtable on-heap threshold is enabled at 128MB\nINFO  12:40:59 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 12:40:59 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-ts1nz
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  12:40:58 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  12:40:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-ts1nz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  12:40:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  12:40:59 Global memtable on-heap threshold is enabled at 128MB
    INFO  12:40:59 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 12:40:59 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4298/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420c9ca40>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 13:19:34.787  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ftm23 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 13:19:34.794  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 13:19:34.896  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 13:19:34 GMT 2017]; root of context hierarchy\n2017-03-20 13:19:36.558  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 13:19:36.584  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 13:19:37.185  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 13:19:37.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.10]\n2017-03-20 13:19:37.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 13:19:37.323  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 13:19:37.356  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.10]:5701\n2017-03-20 13:19:37.357  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 13:19:37.357  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 13:19:37.759  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.10]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 13:19:38.688  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 13:19:38.948  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 13:19:38.950  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 13:19:38.964  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTING\n2017-03-20 13:19:38.966  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 13:19:39.030  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.10]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.10]:5701 - cad14c04-6072-4823-ae4f-73413133a298 this\n}\n\n2017-03-20 13:19:39.105  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTED\n2017-03-20 13:19:39.109  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.291 seconds (JVM running for 6.18)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 13:19:34.787  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ftm23 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-20 13:19:34.794  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 13:19:34.896  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 13:19:34 GMT 2017]; root of context hierarchy
    2017-03-20 13:19:36.558  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 13:19:36.584  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 13:19:37.185  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 13:19:37.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.10]
    2017-03-20 13:19:37.309  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 13:19:37.323  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.10]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 13:19:37.356  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.10]:5701
    2017-03-20 13:19:37.357  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 13:19:37.357  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.10]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 13:19:37.759  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.10]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 13:19:38.688  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.10]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 13:19:38.948  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 13:19:38.950  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.10]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 13:19:38.964  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTING
    2017-03-20 13:19:38.966  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.10]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 13:19:39.030  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.10]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.10]:5701 - cad14c04-6072-4823-ae4f-73413133a298 this
    }

    2017-03-20 13:19:39.105  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.10]:5701 [someGroup] [3.7.5] [10.180.2.10]:5701 is STARTED
    2017-03-20 13:19:39.109  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.291 seconds (JVM running for 6.18)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tqsjr] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421851fb0 exit status 1 <nil> <nil> true [0xc420036708 0xc420036750 0xc420036770] [0xc420036708 0xc420036750 0xc420036770] [0xc420036738 0xc420036768] [0xc37850 0xc37850] 0xc4218031a0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tqsjr] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421851fb0 exit status 1 <nil> <nil> true [0xc420036708 0xc420036750 0xc420036770] [0xc420036708 0xc420036750 0xc420036770] [0xc420036738 0xc420036768] [0xc37850 0xc37850] 0xc4218031a0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4210e7a70>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-56pg0\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  13:43:53 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  13:43:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.13; broadcast_rpc_address=10.180.3.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-56pg0}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  13:43:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  13:43:53 Global memtable on-heap threshold is enabled at 128MB\nINFO  13:43:53 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:43:53 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-56pg0
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  13:43:53 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  13:43:53 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.13; broadcast_rpc_address=10.180.3.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-56pg0}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  13:43:53 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  13:43:53 Global memtable on-heap threshold is enabled at 128MB
    INFO  13:43:53 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 13:43:53 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4299/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420c9e360>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 14:39:20.310  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-llr94 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 14:39:20.319  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 14:39:20.452  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 14:39:20 GMT 2017]; root of context hierarchy\n2017-03-20 14:39:22.275  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 14:39:22.299  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 14:39:22.964  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 14:39:23.091  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-20 14:39:23.092  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 14:39:23.104  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 14:39:23.134  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-20 14:39:23.134  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 14:39:23.135  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 14:39:23.453  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 14:39:24.360  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 14:39:24.636  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 14:39:24.648  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 14:39:24.673  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-20 14:39:24.676  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 14:39:24.710  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - 31ced6bc-ae70-4242-8a2a-78577d9ffce7 this\n}\n\n2017-03-20 14:39:24.775  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-20 14:39:24.789  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.452 seconds (JVM running for 6.322)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 14:39:20.310  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-llr94 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-20 14:39:20.319  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 14:39:20.452  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 14:39:20 GMT 2017]; root of context hierarchy
    2017-03-20 14:39:22.275  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 14:39:22.299  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 14:39:22.964  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 14:39:23.091  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
    2017-03-20 14:39:23.092  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 14:39:23.104  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 14:39:23.134  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
    2017-03-20 14:39:23.134  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 14:39:23.135  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 14:39:23.453  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 14:39:24.360  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 14:39:24.636  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 14:39:24.648  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 14:39:24.673  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
    2017-03-20 14:39:24.676  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 14:39:24.710  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.18]:5701 - 31ced6bc-ae70-4242-8a2a-78577d9ffce7 this
    }

    2017-03-20 14:39:24.775  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
    2017-03-20 14:39:24.789  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.452 seconds (JVM running for 6.322)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.122.106 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pjl65] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421557740 exit status 1 <nil> <nil> true [0xc420484a60 0xc420484a90 0xc420484ae8] [0xc420484a60 0xc420484a90 0xc420484ae8] [0xc420484a78 0xc420484ab8] [0xc37db0 0xc37db0] 0xc4216caae0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.122.106 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pjl65] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421557740 exit status 1 <nil> <nil> true [0xc420484a60 0xc420484a90 0xc420484ae8] [0xc420484a60 0xc420484a90 0xc420484ae8] [0xc420484a78 0xc420484ab8] [0xc37db0 0xc37db0] 0xc4216caae0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420800260>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0qt5w\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  14:36:39 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  14:36:39 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0qt5w}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  14:36:39 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  14:36:39 Global memtable on-heap threshold is enabled at 128MB\nINFO  14:36:39 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:36:39 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0qt5w
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  14:36:39 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  14:36:39 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.14; broadcast_rpc_address=10.180.2.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0qt5w}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  14:36:39 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  14:36:39 Global memtable on-heap threshold is enabled at 128MB
    INFO  14:36:39 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 14:36:39 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4300/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42078f780>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 15:23:16.860  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-kg44w with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 15:23:16.886  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 15:23:17.043  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 15:23:17 GMT 2017]; root of context hierarchy\n2017-03-20 15:23:18.660  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 15:23:18.682  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 15:23:19.387  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 15:23:19.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.4]\n2017-03-20 15:23:19.524  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 15:23:19.537  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 15:23:19.573  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.4]:5701\n2017-03-20 15:23:19.574  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 15:23:19.574  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 15:23:20.046  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.4]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 15:23:20.956  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 15:23:21.290  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 15:23:21.301  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 15:23:21.316  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTING\n2017-03-20 15:23:21.318  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 15:23:21.368  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.4]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.4]:5701 - 8360cdf1-ad12-4859-a482-c8b58ae7eebe this\n}\n\n2017-03-20 15:23:21.427  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTED\n2017-03-20 15:23:21.435  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.664 seconds (JVM running for 6.596)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 15:23:16.860  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-kg44w with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-20 15:23:16.886  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 15:23:17.043  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 15:23:17 GMT 2017]; root of context hierarchy
    2017-03-20 15:23:18.660  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 15:23:18.682  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 15:23:19.387  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 15:23:19.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.4]
    2017-03-20 15:23:19.524  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 15:23:19.537  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.4]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 15:23:19.573  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.4]:5701
    2017-03-20 15:23:19.574  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 15:23:19.574  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.4]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 15:23:20.046  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.4]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 15:23:20.956  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.4]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 15:23:21.290  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 15:23:21.301  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.4]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 15:23:21.316  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTING
    2017-03-20 15:23:21.318  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.4]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 15:23:21.368  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.4]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.4]:5701 - 8360cdf1-ad12-4859-a482-c8b58ae7eebe this
    }

    2017-03-20 15:23:21.427  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.4]:5701 [someGroup] [3.7.5] [10.180.3.4]:5701 is STARTED
    2017-03-20 15:23:21.435  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.664 seconds (JVM running for 6.596)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pqvnd] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42126ebd0 exit status 1 <nil> <nil> true [0xc420574c80 0xc420574ce8 0xc420574d28] [0xc420574c80 0xc420574ce8 0xc420574d28] [0xc420574cb8 0xc420574d10] [0xc37db0 0xc37db0] 0xc4211ab620 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pqvnd] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42126ebd0 exit status 1 <nil> <nil> true [0xc420574c80 0xc420574ce8 0xc420574d28] [0xc420574c80 0xc420574ce8 0xc420574d28] [0xc420574cb8 0xc420574d10] [0xc37db0 0xc37db0] 0xc4211ab620 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421a90940>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.21\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.21\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.21\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.21\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3f4pg\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  15:51:03 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  15:51:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.21; broadcast_rpc_address=10.180.3.21; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.21; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3f4pg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  15:51:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  15:51:03 Global memtable on-heap threshold is enabled at 128MB\nINFO  15:51:03 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:51:03 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.21
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.21
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.21
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.21
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3f4pg
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  15:51:03 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  15:51:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.21; broadcast_rpc_address=10.180.3.21; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.21; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3f4pg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  15:51:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  15:51:03 Global memtable on-heap threshold is enabled at 128MB
    INFO  15:51:03 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 15:51:03 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4301/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420dae030>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 16:47:06.641  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-zt1mt with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-20 16:47:06.649  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 16:47:06.813  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 16:47:06 GMT 2017]; root of context hierarchy\n2017-03-20 16:47:08.473  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 16:47:08.499  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 16:47:09.159  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 16:47:09.300  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-20 16:47:09.301  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 16:47:09.313  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 16:47:09.357  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-20 16:47:09.358  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 16:47:09.358  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 16:47:09.723  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 16:47:10.590  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 16:47:10.915  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 16:47:10.933  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 16:47:10.943  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-20 16:47:10.947  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 16:47:10.981  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - f0e31395-a3b8-45eb-ad00-6b7178b0e955 this\n}\n\n2017-03-20 16:47:11.092  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-20 16:47:11.096  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.552 seconds (JVM running for 6.491)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 16:47:06.641  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-zt1mt with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-20 16:47:06.649  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 16:47:06.813  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 16:47:06 GMT 2017]; root of context hierarchy
    2017-03-20 16:47:08.473  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 16:47:08.499  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 16:47:09.159  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 16:47:09.300  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
    2017-03-20 16:47:09.301  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 16:47:09.313  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 16:47:09.357  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
    2017-03-20 16:47:09.358  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 16:47:09.358  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 16:47:09.723  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 16:47:10.590  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 16:47:10.915  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 16:47:10.933  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 16:47:10.943  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
    2017-03-20 16:47:10.947  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 16:47:10.981  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.18]:5701 - f0e31395-a3b8-45eb-ad00-6b7178b0e955 this
    }

    2017-03-20 16:47:11.092  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
    2017-03-20 16:47:11.096  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.552 seconds (JVM running for 6.491)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420f523d0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.16\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.16\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.16\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.16\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-gc2z2\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  17:02:30 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  17:02:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.16; broadcast_rpc_address=10.180.2.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gc2z2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  17:02:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  17:02:31 Global memtable on-heap threshold is enabled at 128MB\nINFO  17:02:31 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:02:31 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.16
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.16
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.16
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.16
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-gc2z2
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  17:02:30 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  17:02:30 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.16; broadcast_rpc_address=10.180.2.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gc2z2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  17:02:30 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  17:02:31 Global memtable on-heap threshold is enabled at 128MB
    INFO  17:02:31 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 17:02:31 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.156.139 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-2k6dm] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4214d9fb0 exit status 1 <nil> <nil> true [0xc4203241c8 0xc4203241f0 0xc420324208] [0xc4203241c8 0xc4203241f0 0xc420324208] [0xc4203241e8 0xc420324200] [0xc37db0 0xc37db0] 0xc42083d260 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.156.139 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-2k6dm] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4214d9fb0 exit status 1 <nil> <nil> true [0xc4203241c8 0xc4203241f0 0xc420324208] [0xc4203241c8 0xc4203241f0 0xc420324208] [0xc4203241e8 0xc420324200] [0xc37db0 0xc37db0] 0xc42083d260 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4302/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420b3da90>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-20 17:48:24.543  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-xzs6x with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-20 17:48:24.550  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-20 17:48:24.687  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 17:48:24 GMT 2017]; root of context hierarchy\n2017-03-20 17:48:26.440  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-20 17:48:26.464  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-20 17:48:27.095  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-20 17:48:27.238  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-20 17:48:27.239  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-20 17:48:27.250  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-20 17:48:27.293  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-20 17:48:27.294  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-20 17:48:27.294  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-20 17:48:27.618  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-20 17:48:28.452  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-20 17:48:28.716  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-20 17:48:28.726  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-20 17:48:28.737  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-20 17:48:28.738  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-20 17:48:28.769  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - fd46c90d-ff0a-40cf-8a98-afba10f24924 this\n}\n\n2017-03-20 17:48:28.836  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-20 17:48:28.850  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.286 seconds (JVM running for 6.211)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-20 17:48:24.543  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-xzs6x with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-20 17:48:24.550  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-20 17:48:24.687  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Mon Mar 20 17:48:24 GMT 2017]; root of context hierarchy
    2017-03-20 17:48:26.440  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-20 17:48:26.464  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-20 17:48:27.095  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-20 17:48:27.238  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
    2017-03-20 17:48:27.239  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-20 17:48:27.250  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-20 17:48:27.293  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
    2017-03-20 17:48:27.294  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-20 17:48:27.294  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-20 17:48:27.618  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-20 17:48:28.452  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-20 17:48:28.716  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-20 17:48:28.726  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-20 17:48:28.737  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
    2017-03-20 17:48:28.738  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-20 17:48:28.769  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.14]:5701 - fd46c90d-ff0a-40cf-8a98-afba10f24924 this
    }

    2017-03-20 17:48:28.836  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
    2017-03-20 17:48:28.850  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.286 seconds (JVM running for 6.211)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-6skkk] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f3c300 exit status 1 <nil> <nil> true [0xc420255118 0xc420255138 0xc420255150] [0xc420255118 0xc420255138 0xc420255150] [0xc420255130 0xc420255148] [0xc37db0 0xc37db0] 0xc42146a780 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-6skkk] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f3c300 exit status 1 <nil> <nil> true [0xc420255118 0xc420255138 0xc420255150] [0xc420255118 0xc420255138 0xc420255150] [0xc420255130 0xc420255148] [0xc37db0 0xc37db0] 0xc42146a780 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4220f82c0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-hww3g\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:10:16 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:10:17 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hww3g}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:10:17 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:10:17 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:10:17 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:10:17 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-hww3g
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  18:10:16 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:10:17 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hww3g}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:10:17 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:10:17 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:10:17 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:10:17 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574 #43344