kubernetes / kubernetes

Production-Grade Container Scheduling and Management
https://kubernetes.io
Apache License 2.0
107k stars 38.47k forks source link

ci-kubernetes-e2e-gce-examples: broken test run #43193

Closed k8s-github-robot closed 6 years ago

k8s-github-robot commented 7 years ago

https://storage.googleapis.com/k8s-gubernator/triage/index.html#451144a9be5d4451ad3c

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4198/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4211e6310>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 04:39:24.296  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-xzmwt with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 04:39:24.319  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 04:39:24.435  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 04:39:24 GMT 2017]; root of context hierarchy\n2017-03-16 04:39:26.181  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 04:39:26.202  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 04:39:26.855  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed\n\njava.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]\n\tat com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]\n\tat org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]\n\tat java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]\n\tat org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]\n\n2017-03-16 04:39:26.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.\n2017-03-16 04:39:26.990  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []\n2017-03-16 04:39:26.992  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 04:39:26.992  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.\n2017-03-16 04:39:27.009  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 04:39:27.045  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 04:39:27.404  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 04:39:28.250  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 04:39:28.527  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 04:39:28.537  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 04:39:28.546  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-16 04:39:28.552  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 04:39:28.594  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 2ea824d1-646d-467c-a70f-d7aedc318e9f this\n}\n\n2017-03-16 04:39:28.671  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-16 04:39:28.676  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.313 seconds (JVM running for 6.194)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 04:39:24.296  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-xzmwt with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 04:39:24.319  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 04:39:24.435  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 04:39:24 GMT 2017]; root of context hierarchy
    2017-03-16 04:39:26.181  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 04:39:26.202  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 04:39:26.855  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed

    java.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]
        at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]
        at com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]
        at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]
        at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]
        at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]
        at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]
        at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]

    2017-03-16 04:39:26.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.
    2017-03-16 04:39:26.990  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []
    2017-03-16 04:39:26.992  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 04:39:26.992  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.
    2017-03-16 04:39:27.009  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
    2017-03-16 04:39:27.044  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 04:39:27.045  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 04:39:27.404  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 04:39:28.250  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 04:39:28.527  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 04:39:28.537  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 04:39:28.546  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
    2017-03-16 04:39:28.552  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 04:39:28.594  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.6]:5701 - 2ea824d1-646d-467c-a70f-d7aedc318e9f this
    }

    2017-03-16 04:39:28.671  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
    2017-03-16 04:39:28.676  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.313 seconds (JVM running for 6.194)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5frwm] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420fd98f0 exit status 1 <nil> <nil> true [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886e0 0xc4204886f8] [0xc35000 0xc35000] 0xc420d5d800 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5frwm] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420fd98f0 exit status 1 <nil> <nil> true [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886c8 0xc4204886e8 0xc420488700] [0xc4204886e0 0xc4204886f8] [0xc35000 0xc35000] 0xc420d5d800 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421357f70>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3bthz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:04:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:04:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3bthz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:04:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:04:41 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:04:41 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:04:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3bthz
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  05:04:40 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:04:40 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3bthz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:04:40 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:04:41 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:04:41 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:04:41 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Previous issues for this suite: #36930 #37437 #38393 #38578 #39379 #40341 #43015

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4199/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4210a7570>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 05:38:22.790  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-kqv1m with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 05:38:22.818  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 05:38:22.915  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 05:38:22 GMT 2017]; root of context hierarchy\n2017-03-16 05:38:24.395  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 05:38:24.417  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 05:38:24.938  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed\n\njava.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]\n\tat sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]\n\tat com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]\n\tat org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]\n\tat com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]\n\tat java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]\n\tat org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]\n\tat org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]\n\n2017-03-16 05:38:24.939  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.\n2017-03-16 05:38:25.063  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []\n2017-03-16 05:38:25.065  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 05:38:25.065  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.\n2017-03-16 05:38:25.078  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701\n2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 05:38:25.407  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 05:38:26.150  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 05:38:26.398  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 05:38:26.410  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 05:38:26.447  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING\n2017-03-16 05:38:26.457  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 05:38:26.474  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.8]:5701 - c3b7548a-3ae9-428f-9bbf-2c323b11240c this\n}\n\n2017-03-16 05:38:26.554  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED\n2017-03-16 05:38:26.557  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.671 seconds (JVM running for 5.506)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 05:38:22.790  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-1880832617-kqv1m with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 05:38:22.818  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 05:38:22.915  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 05:38:22 GMT 2017]; root of context hierarchy
    2017-03-16 05:38:24.395  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 05:38:24.417  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 05:38:24.938  WARN 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Request to Kubernetes API failed

    java.io.IOException: Server returned HTTP response code: 403 for URL: https://kubernetes.default.svc.cluster.local/api/v1/namespaces/default/endpoints/hazelcast
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1876) ~[na:1.8.0_111]
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) ~[na:1.8.0_111]
        at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:254) ~[na:1.8.0_111]
        at com.github.pires.hazelcast.HazelcastDiscoveryController.run(HazelcastDiscoveryController.java:118) ~[classes!/:na]
        at org.springframework.boot.SpringApplication.callRunner(SpringApplication.java:801) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.SpringApplication.callRunners(SpringApplication.java:785) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.SpringApplication.afterRefresh(SpringApplication.java:772) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.SpringApplication.run(SpringApplication.java:317) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134) [spring-boot-1.4.4.RELEASE.jar!/:1.4.4.RELEASE]
        at com.github.pires.hazelcast.Application.main(Application.java:28) [classes!/:na]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_111]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_111]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_111]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_111]
        at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) [bootstrapper.jar:na]
        at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) [bootstrapper.jar:na]
        at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) [bootstrapper.jar:na]
        at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51) [bootstrapper.jar:na]

    2017-03-16 05:38:24.939  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 0 pods running Hazelcast.
    2017-03-16 05:38:25.063  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: []
    2017-03-16 05:38:25.065  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 05:38:25.065  WARN 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Could not find a matching address to start with! Picking one of non-loopback addresses.
    2017-03-16 05:38:25.078  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701
    2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 05:38:25.110  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 05:38:25.407  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 05:38:26.150  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 05:38:26.398  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 05:38:26.410  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 05:38:26.447  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING
    2017-03-16 05:38:26.457  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 05:38:26.474  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.8]:5701 - c3b7548a-3ae9-428f-9bbf-2c323b11240c this
    }

    2017-03-16 05:38:26.554  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED
    2017-03-16 05:38:26.557  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.671 seconds (JVM running for 5.506)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-4lnmf] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f4ee40 exit status 1 <nil> <nil> true [0xc420488058 0xc420488088 0xc4204880c0] [0xc420488058 0xc420488088 0xc4204880c0] [0xc420488078 0xc4204880b0] [0xc35000 0xc35000] 0xc42109d140 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.181.84 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-4lnmf] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f4ee40 exit status 1 <nil> <nil> true [0xc420488058 0xc420488088 0xc4204880c0] [0xc420488058 0xc420488088 0xc4204880c0] [0xc420488078 0xc4204880b0] [0xc35000 0xc35000] 0xc42109d140 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4215c3bd0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0h0dt\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:02:30 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:02:31 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0h0dt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:02:31 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:02:31 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:02:31 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:02:31 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0h0dt
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  06:02:30 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:02:31 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0h0dt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:02:31 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:02:31 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:02:31 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:02:31 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4200/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420d2ef00>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-1tjzk\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:38:08 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:38:08 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1tjzk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:38:08 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:38:08 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:38:08 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:38:08 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-1tjzk
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  06:38:08 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:38:08 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.8; broadcast_rpc_address=10.180.2.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1tjzk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:38:08 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:38:08 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:38:08 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:38:08 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://108.59.87.136 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-r8f8x] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421118210 exit status 1 <nil> <nil> true [0xc42204e180 0xc42204e198 0xc42204e1b0] [0xc42204e180 0xc42204e198 0xc42204e1b0] [0xc42204e190 0xc42204e1a8] [0xc35000 0xc35000] 0xc420c384e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://108.59.87.136 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-r8f8x] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421118210 exit status 1 <nil> <nil> true [0xc42204e180 0xc42204e198 0xc42204e1b0] [0xc42204e180 0xc42204e198 0xc42204e1b0] [0xc42204e190 0xc42204e1a8] [0xc35000 0xc35000] 0xc420c384e0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4222b2270>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 06:55:50.428  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-3x850 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 06:55:50.442  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 06:55:50.552  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 06:55:50 GMT 2017]; root of context hierarchy\n2017-03-16 06:55:52.339  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 06:55:52.360  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 06:55:52.997  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 06:55:53.113  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.22]\n2017-03-16 06:55:53.113  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 06:55:53.125  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 06:55:53.157  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.22]:5701\n2017-03-16 06:55:53.158  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 06:55:53.158  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 06:55:53.518  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.22]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 06:55:54.628  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 06:55:54.875  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 06:55:54.883  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 06:55:54.895  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.22]:5701 [someGroup] [3.7.5] [10.180.2.22]:5701 is STARTING\n2017-03-16 06:55:54.896  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 06:55:54.954  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.22]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.22]:5701 - 6a4a687a-5a04-4243-8382-1f22cd9eaf8e this\n}\n\n2017-03-16 06:55:55.003  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.22]:5701 [someGroup] [3.7.5] [10.180.2.22]:5701 is STARTED\n2017-03-16 06:55:55.015  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.732 seconds (JVM running for 6.676)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 06:55:50.428  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-3x850 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 06:55:50.442  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 06:55:50.552  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 06:55:50 GMT 2017]; root of context hierarchy
    2017-03-16 06:55:52.339  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 06:55:52.360  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 06:55:52.997  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 06:55:53.113  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.22]
    2017-03-16 06:55:53.113  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 06:55:53.125  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.22]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 06:55:53.157  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.22]:5701
    2017-03-16 06:55:53.158  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 06:55:53.158  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.22]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 06:55:53.518  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.22]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 06:55:54.628  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.22]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 06:55:54.875  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.22]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 06:55:54.883  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.22]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 06:55:54.895  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.22]:5701 [someGroup] [3.7.5] [10.180.2.22]:5701 is STARTING
    2017-03-16 06:55:54.896  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.22]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 06:55:54.954  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.22]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.22]:5701 - 6a4a687a-5a04-4243-8382-1f22cd9eaf8e this
    }

    2017-03-16 06:55:55.003  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.22]:5701 [someGroup] [3.7.5] [10.180.2.22]:5701 is STARTED
    2017-03-16 06:55:55.015  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.732 seconds (JVM running for 6.676)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4201/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.21.252 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v0spg] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420b8aea0 exit status 1 <nil> <nil> true [0xc42044e0c0 0xc42044e0d8 0xc42044e0f0] [0xc42044e0c0 0xc42044e0d8 0xc42044e0f0] [0xc42044e0d0 0xc42044e0e8] [0xc35000 0xc35000] 0xc4207ac3c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.21.252 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v0spg] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420b8aea0 exit status 1 <nil> <nil> true [0xc42044e0c0 0xc42044e0d8 0xc42044e0f0] [0xc42044e0c0 0xc42044e0d8 0xc42044e0f0] [0xc42044e0d0 0xc42044e0e8] [0xc35000 0xc35000] 0xc4207ac3c0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420d64690>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.0.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.0.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.0.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-vm6z8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  07:40:58 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  07:40:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.7; broadcast_rpc_address=10.180.0.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vm6z8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  07:40:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  07:40:58 Global memtable on-heap threshold is enabled at 128MB\nINFO  07:40:58 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 07:40:58 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.0.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.0.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.0.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-vm6z8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  07:40:58 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  07:40:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.7; broadcast_rpc_address=10.180.0.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vm6z8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  07:40:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  07:40:58 Global memtable on-heap threshold is enabled at 128MB
    INFO  07:40:58 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 07:40:58 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420c82dd0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 07:46:00.934  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gngjk with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 07:46:00.949  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 07:46:01.078  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 07:46:01 GMT 2017]; root of context hierarchy\n2017-03-16 07:46:02.752  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 07:46:02.769  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 07:46:03.359  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 07:46:03.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]\n2017-03-16 07:46:03.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 07:46:03.481  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701\n2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 07:46:03.830  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 07:46:04.679  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 07:46:04.952  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 07:46:04.966  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 07:46:04.995  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING\n2017-03-16 07:46:04.998  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 07:46:05.029  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.9]:5701 - 34a1a1e7-a99d-4900-bffc-5b851dd1b1a8 this\n}\n\n2017-03-16 07:46:05.138  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED\n2017-03-16 07:46:05.143  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.11 seconds (JVM running for 6.03)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 07:46:00.934  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gngjk with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 07:46:00.949  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 07:46:01.078  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 07:46:01 GMT 2017]; root of context hierarchy
    2017-03-16 07:46:02.752  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 07:46:02.769  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 07:46:03.359  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 07:46:03.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]
    2017-03-16 07:46:03.470  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 07:46:03.481  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701
    2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 07:46:03.516  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 07:46:03.830  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 07:46:04.679  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 07:46:04.952  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 07:46:04.966  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 07:46:04.995  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING
    2017-03-16 07:46:04.998  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 07:46:05.029  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.9]:5701 - 34a1a1e7-a99d-4900-bffc-5b851dd1b1a8 this
    }

    2017-03-16 07:46:05.138  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED
    2017-03-16 07:46:05.143  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.11 seconds (JVM running for 6.03)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4202/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.246.223 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7hc6w] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e7b9e0 exit status 1 <nil> <nil> true [0xc420b24608 0xc420b24660 0xc420b24688] [0xc420b24608 0xc420b24660 0xc420b24688] [0xc420b24648 0xc420b24678] [0xc35000 0xc35000] 0xc420851800 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.246.223 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7hc6w] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420e7b9e0 exit status 1 <nil> <nil> true [0xc420b24608 0xc420b24660 0xc420b24688] [0xc420b24608 0xc420b24660 0xc420b24688] [0xc420b24648 0xc420b24678] [0xc35000 0xc35000] 0xc420851800 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421c0ce20>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-17bjb\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  08:37:36 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  08:37:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-17bjb}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  08:37:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  08:37:36 Global memtable on-heap threshold is enabled at 128MB\nINFO  08:37:36 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 08:37:36 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-17bjb
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  08:37:36 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  08:37:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-17bjb}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  08:37:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  08:37:36 Global memtable on-heap threshold is enabled at 128MB
    INFO  08:37:36 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 08:37:36 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420c8c050>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 08:40:12.084  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hldm8 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 08:40:12.093  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 08:40:12.243  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 08:40:12 GMT 2017]; root of context hierarchy\n2017-03-16 08:40:13.958  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 08:40:13.993  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 08:40:14.749  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 08:40:14.980  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]\n2017-03-16 08:40:14.981  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 08:40:14.993  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 08:40:15.030  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701\n2017-03-16 08:40:15.030  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 08:40:15.031  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 08:40:15.399  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 08:40:16.282  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 08:40:16.623  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 08:40:16.652  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 08:40:16.666  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING\n2017-03-16 08:40:16.669  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 08:40:16.702  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.8]:5701 - c01642a3-6a7a-4026-861c-cfaa925aed21 this\n}\n\n2017-03-16 08:40:16.789  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED\n2017-03-16 08:40:16.794  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.774 seconds (JVM running for 6.683)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 08:40:12.084  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hldm8 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 08:40:12.093  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 08:40:12.243  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 08:40:12 GMT 2017]; root of context hierarchy
    2017-03-16 08:40:13.958  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 08:40:13.993  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 08:40:14.749  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 08:40:14.980  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]
    2017-03-16 08:40:14.981  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 08:40:14.993  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 08:40:15.030  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701
    2017-03-16 08:40:15.030  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 08:40:15.031  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 08:40:15.399  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 08:40:16.282  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 08:40:16.623  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 08:40:16.652  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 08:40:16.666  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING
    2017-03-16 08:40:16.669  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 08:40:16.702  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.8]:5701 - c01642a3-6a7a-4026-861c-cfaa925aed21 this
    }

    2017-03-16 08:40:16.789  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED
    2017-03-16 08:40:16.794  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.774 seconds (JVM running for 6.683)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4203/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421b12570>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-6g2bt\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  09:35:00 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  09:35:01 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6g2bt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  09:35:01 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  09:35:01 Global memtable on-heap threshold is enabled at 128MB\nINFO  09:35:01 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:35:01 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-6g2bt
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  09:35:00 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  09:35:01 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6g2bt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  09:35:01 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  09:35:01 Global memtable on-heap threshold is enabled at 128MB
    INFO  09:35:01 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 09:35:01 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421afa4d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 09:45:44.253  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hjwxd with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 09:45:44.279  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 09:45:44.384  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 09:45:44 GMT 2017]; root of context hierarchy\n2017-03-16 09:45:46.067  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 09:45:46.084  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 09:45:46.761  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 09:45:46.907  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.19]\n2017-03-16 09:45:46.908  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 09:45:46.920  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 09:45:46.954  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.19]:5701\n2017-03-16 09:45:46.955  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 09:45:46.955  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 09:45:47.330  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.19]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 09:45:48.190  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 09:45:48.450  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 09:45:48.466  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 09:45:48.482  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTING\n2017-03-16 09:45:48.486  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 09:45:48.535  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.19]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.19]:5701 - 62a749fc-bba0-4f81-8b6c-02acfda01109 this\n}\n\n2017-03-16 09:45:48.610  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTED\n2017-03-16 09:45:48.616  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.349 seconds (JVM running for 6.223)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 09:45:44.253  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hjwxd with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 09:45:44.279  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 09:45:44.384  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 09:45:44 GMT 2017]; root of context hierarchy
    2017-03-16 09:45:46.067  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 09:45:46.084  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 09:45:46.761  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 09:45:46.907  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.19]
    2017-03-16 09:45:46.908  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 09:45:46.920  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 09:45:46.954  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.19]:5701
    2017-03-16 09:45:46.955  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 09:45:46.955  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 09:45:47.330  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.19]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 09:45:48.190  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 09:45:48.450  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 09:45:48.466  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 09:45:48.482  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTING
    2017-03-16 09:45:48.486  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 09:45:48.535  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.19]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.19]:5701 - 62a749fc-bba0-4f81-8b6c-02acfda01109 this
    }

    2017-03-16 09:45:48.610  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTED
    2017-03-16 09:45:48.616  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.349 seconds (JVM running for 6.223)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.13.129 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wj2w6] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420dfc270 exit status 1 <nil> <nil> true [0xc420ec4608 0xc420ec4620 0xc420ec4638] [0xc420ec4608 0xc420ec4620 0xc420ec4638] [0xc420ec4618 0xc420ec4630] [0xc35000 0xc35000] 0xc4211fe000 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.188.13.129 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wj2w6] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420dfc270 exit status 1 <nil> <nil> true [0xc420ec4608 0xc420ec4620 0xc420ec4638] [0xc420ec4608 0xc420ec4620 0xc420ec4638] [0xc420ec4618 0xc420ec4630] [0xc35000 0xc35000] 0xc4211fe000 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4204/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421ba22b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-5xcq8\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  10:37:21 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  10:37:21 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5xcq8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  10:37:21 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  10:37:21 Global memtable on-heap threshold is enabled at 128MB\nINFO  10:37:21 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 10:37:21 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-5xcq8
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  10:37:21 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  10:37:21 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.15; broadcast_rpc_address=10.180.2.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5xcq8}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  10:37:21 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  10:37:21 Global memtable on-heap threshold is enabled at 128MB
    INFO  10:37:21 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 10:37:21 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421bce020>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 10:45:14.474  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ccwg8 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 10:45:14.490  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 10:45:14.597  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 10:45:14 GMT 2017]; root of context hierarchy\n2017-03-16 10:45:16.537  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 10:45:16.556  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 10:45:17.178  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 10:45:17.349  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.20]\n2017-03-16 10:45:17.349  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 10:45:17.362  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.20]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 10:45:17.440  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.20]:5701\n2017-03-16 10:45:17.441  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 10:45:17.441  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 10:45:17.883  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.20]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 10:45:18.807  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.20]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 10:45:19.088  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.20]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 10:45:19.098  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.20]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 10:45:19.111  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.20]:5701 [someGroup] [3.7.5] [10.180.2.20]:5701 is STARTING\n2017-03-16 10:45:19.113  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.20]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 10:45:19.164  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.20]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.20]:5701 - 8575eac0-6efb-428f-ae58-ae27e35b45b9 this\n}\n\n2017-03-16 10:45:19.236  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.20]:5701 [someGroup] [3.7.5] [10.180.2.20]:5701 is STARTED\n2017-03-16 10:45:19.244  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.789 seconds (JVM running for 6.7)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 10:45:14.474  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-ccwg8 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 10:45:14.490  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 10:45:14.597  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 10:45:14 GMT 2017]; root of context hierarchy
    2017-03-16 10:45:16.537  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 10:45:16.556  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 10:45:17.178  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 10:45:17.349  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.20]
    2017-03-16 10:45:17.349  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 10:45:17.362  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.20]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 10:45:17.440  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.20]:5701
    2017-03-16 10:45:17.441  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 10:45:17.441  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.20]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 10:45:17.883  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.20]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 10:45:18.807  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.20]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 10:45:19.088  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.20]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 10:45:19.098  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.20]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 10:45:19.111  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.20]:5701 [someGroup] [3.7.5] [10.180.2.20]:5701 is STARTING
    2017-03-16 10:45:19.113  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.20]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 10:45:19.164  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.20]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.20]:5701 - 8575eac0-6efb-428f-ae58-ae27e35b45b9 this
    }

    2017-03-16 10:45:19.236  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.20]:5701 [someGroup] [3.7.5] [10.180.2.20]:5701 is STARTED
    2017-03-16 10:45:19.244  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.789 seconds (JVM running for 6.7)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ds4dn] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4211100c0 exit status 1 <nil> <nil> true [0xc4200369f0 0xc420036a08 0xc420036a20] [0xc4200369f0 0xc420036a08 0xc420036a20] [0xc420036a00 0xc420036a18] [0xc35000 0xc35000] 0xc42135dbc0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-ds4dn] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4211100c0 exit status 1 <nil> <nil> true [0xc4200369f0 0xc420036a08 0xc420036a20] [0xc4200369f0 0xc420036a08 0xc420036a20] [0xc420036a00 0xc420036a18] [0xc35000 0xc35000] 0xc42135dbc0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4205/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420de8090>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.5\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.5\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.5\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.5\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-b13pg\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:30:11 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:30:11 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.5; broadcast_rpc_address=10.180.3.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b13pg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:30:11 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:30:12 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:30:12 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 11:30:12 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.5
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.5
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.5
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.5
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-b13pg
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  11:30:11 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:30:11 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.5; broadcast_rpc_address=10.180.3.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b13pg}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:30:11 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:30:12 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:30:12 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 11:30:12 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4219c7800>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 11:43:31.514  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-rvmv1 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 11:43:31.521  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 11:43:31.644  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 11:43:31 GMT 2017]; root of context hierarchy\n2017-03-16 11:43:33.543  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 11:43:33.572  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 11:43:34.234  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 11:43:34.347  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]\n2017-03-16 11:43:34.348  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 11:43:34.361  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 11:43:34.394  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701\n2017-03-16 11:43:34.395  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 11:43:34.395  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 11:43:34.714  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 11:43:35.602  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 11:43:35.960  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 11:43:35.963  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 11:43:35.978  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING\n2017-03-16 11:43:35.982  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 11:43:36.008  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.15]:5701 - 462447fe-75cb-48ed-9318-3d8ba6e85f67 this\n}\n\n2017-03-16 11:43:36.087  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED\n2017-03-16 11:43:36.098  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.54 seconds (JVM running for 6.48)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 11:43:31.514  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-rvmv1 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 11:43:31.521  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 11:43:31.644  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 11:43:31 GMT 2017]; root of context hierarchy
    2017-03-16 11:43:33.543  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 11:43:33.572  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 11:43:34.234  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 11:43:34.347  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]
    2017-03-16 11:43:34.348  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 11:43:34.361  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 11:43:34.394  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701
    2017-03-16 11:43:34.395  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 11:43:34.395  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 11:43:34.714  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 11:43:35.602  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 11:43:35.960  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 11:43:35.963  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 11:43:35.978  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING
    2017-03-16 11:43:35.982  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 11:43:36.008  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.15]:5701 - 462447fe-75cb-48ed-9318-3d8ba6e85f67 this
    }

    2017-03-16 11:43:36.087  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED
    2017-03-16 11:43:36.098  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.54 seconds (JVM running for 6.48)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.178.224 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nhqgs] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421125410 exit status 1 <nil> <nil> true [0xc4205a66c8 0xc4205a6700 0xc4205a6728] [0xc4205a66c8 0xc4205a6700 0xc4205a6728] [0xc4205a66e8 0xc4205a6718] [0xc35000 0xc35000] 0xc420eee4e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.154.178.224 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nhqgs] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421125410 exit status 1 <nil> <nil> true [0xc4205a66c8 0xc4205a6700 0xc4205a6728] [0xc4205a66c8 0xc4205a6700 0xc4205a6728] [0xc4205a66e8 0xc4205a6718] [0xc35000 0xc35000] 0xc420eee4e0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4206/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4215325b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 12:36:46.265  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5xsz3 with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 12:36:46.283  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 12:36:46.444  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 12:36:46 GMT 2017]; root of context hierarchy\n2017-03-16 12:36:47.916  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 12:36:47.936  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 12:36:48.595  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 12:36:48.719  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.8]\n2017-03-16 12:36:48.719  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 12:36:48.732  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 12:36:48.768  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.8]:5701\n2017-03-16 12:36:48.768  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 12:36:48.769  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 12:36:49.215  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 12:36:49.998  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 12:36:50.250  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 12:36:50.266  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 12:36:50.299  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTING\n2017-03-16 12:36:50.318  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 12:36:50.376  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.8]:5701 - 14b1add2-c0f5-49ba-bc87-d39a91e899dd this\n}\n\n2017-03-16 12:36:50.452  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTED\n2017-03-16 12:36:50.460  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.169 seconds (JVM running for 6.001)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 12:36:46.265  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5xsz3 with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 12:36:46.283  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 12:36:46.444  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 12:36:46 GMT 2017]; root of context hierarchy
    2017-03-16 12:36:47.916  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 12:36:47.936  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 12:36:48.595  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 12:36:48.719  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.8]
    2017-03-16 12:36:48.719  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 12:36:48.732  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 12:36:48.768  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.8]:5701
    2017-03-16 12:36:48.768  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 12:36:48.769  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 12:36:49.215  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 12:36:49.998  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 12:36:50.250  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 12:36:50.266  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 12:36:50.299  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTING
    2017-03-16 12:36:50.318  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 12:36:50.376  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.8]:5701 - 14b1add2-c0f5-49ba-bc87-d39a91e899dd this
    }

    2017-03-16 12:36:50.452  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTED
    2017-03-16 12:36:50.460  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.169 seconds (JVM running for 6.001)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.1.59 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gp3j7] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f07b60 exit status 1 <nil> <nil> true [0xc4200364e8 0xc420036508 0xc420036530] [0xc4200364e8 0xc420036508 0xc420036530] [0xc420036500 0xc420036528] [0xc35000 0xc35000] 0xc420c22d80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.1.59 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gp3j7] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f07b60 exit status 1 <nil> <nil> true [0xc4200364e8 0xc420036508 0xc420036530] [0xc4200364e8 0xc420036508 0xc420036530] [0xc420036500 0xc420036528] [0xc35000 0xc35000] 0xc420c22d80 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420b0f270>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0454d\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  12:33:57 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  12:33:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.7; broadcast_rpc_address=10.180.2.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0454d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  12:33:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  12:33:58 Global memtable on-heap threshold is enabled at 128MB\nINFO  12:33:58 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 12:33:58 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0454d
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  12:33:57 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  12:33:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.7; broadcast_rpc_address=10.180.2.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0454d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  12:33:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  12:33:58 Global memtable on-heap threshold is enabled at 128MB
    INFO  12:33:58 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 12:33:58 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4207/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42119a4b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 13:28:54.809  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gg22v with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 13:28:54.822  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 13:28:54.925  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 13:28:54 GMT 2017]; root of context hierarchy\n2017-03-16 13:28:56.541  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 13:28:56.563  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 13:28:57.155  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 13:28:57.287  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.12]\n2017-03-16 13:28:57.287  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 13:28:57.298  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 13:28:57.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.12]:5701\n2017-03-16 13:28:57.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 13:28:57.332  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 13:28:57.677  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.12]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 13:28:58.570  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 13:28:58.875  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 13:28:58.882  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 13:28:58.892  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.12]:5701 [someGroup] [3.7.5] [10.180.1.12]:5701 is STARTING\n2017-03-16 13:28:58.894  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 13:28:58.940  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.12]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.12]:5701 - a6d73a88-b142-499b-8d48-a85e905cd9f3 this\n}\n\n2017-03-16 13:28:59.018  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.12]:5701 [someGroup] [3.7.5] [10.180.1.12]:5701 is STARTED\n2017-03-16 13:28:59.021  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.262 seconds (JVM running for 6.105)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 13:28:54.809  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gg22v with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 13:28:54.822  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 13:28:54.925  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 13:28:54 GMT 2017]; root of context hierarchy
    2017-03-16 13:28:56.541  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 13:28:56.563  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 13:28:57.155  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 13:28:57.287  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.12]
    2017-03-16 13:28:57.287  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 13:28:57.298  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 13:28:57.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.12]:5701
    2017-03-16 13:28:57.331  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 13:28:57.332  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 13:28:57.677  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.12]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 13:28:58.570  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 13:28:58.875  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 13:28:58.882  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 13:28:58.892  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.12]:5701 [someGroup] [3.7.5] [10.180.1.12]:5701 is STARTING
    2017-03-16 13:28:58.894  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 13:28:58.940  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.12]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.12]:5701 - a6d73a88-b142-499b-8d48-a85e905cd9f3 this
    }

    2017-03-16 13:28:59.018  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.12]:5701 [someGroup] [3.7.5] [10.180.1.12]:5701 is STARTED
    2017-03-16 13:28:59.021  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.262 seconds (JVM running for 6.105)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420ba4210>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-7bd6d\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  13:43:48 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  13:43:48 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7bd6d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  13:43:48 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  13:43:48 Global memtable on-heap threshold is enabled at 128MB\nINFO  13:43:48 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 13:43:48 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-7bd6d
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  13:43:48 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  13:43:48 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7bd6d}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  13:43:48 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  13:43:48 Global memtable on-heap threshold is enabled at 128MB
    INFO  13:43:48 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 13:43:48 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-sqwfr] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420dd1770 exit status 1 <nil> <nil> true [0xc4200365e0 0xc420036608 0xc420036640] [0xc4200365e0 0xc420036608 0xc420036640] [0xc4200365f8 0xc420036620] [0xc35000 0xc35000] 0xc4211b7320 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-sqwfr] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420dd1770 exit status 1 <nil> <nil> true [0xc4200365e0 0xc420036608 0xc420036640] [0xc4200365e0 0xc420036608 0xc420036640] [0xc4200365f8 0xc420036620] [0xc35000 0xc35000] 0xc4211b7320 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4208/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wkslf] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420a36210 exit status 1 <nil> <nil> true [0xc4202627b0 0xc4202627c8 0xc4202627e0] [0xc4202627b0 0xc4202627c8 0xc4202627e0] [0xc4202627c0 0xc4202627d8] [0xc35000 0xc35000] 0xc420c04de0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wkslf] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420a36210 exit status 1 <nil> <nil> true [0xc4202627b0 0xc4202627c8 0xc4202627e0] [0xc4202627b0 0xc4202627c8 0xc4202627e0] [0xc4202627c0 0xc4202627d8] [0xc35000 0xc35000] 0xc420c04de0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4207ce570>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.22\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.22\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.22\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.22\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-kt0xh\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  14:33:48 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  14:33:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.22; broadcast_rpc_address=10.180.1.22; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.22; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-kt0xh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  14:33:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  14:33:49 Global memtable on-heap threshold is enabled at 128MB\nINFO  14:33:49 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:33:49 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.22
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.22
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.22
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.22
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-kt0xh
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  14:33:48 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  14:33:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.22; broadcast_rpc_address=10.180.1.22; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.22; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-kt0xh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  14:33:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  14:33:49 Global memtable on-heap threshold is enabled at 128MB
    INFO  14:33:49 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 14:33:49 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42177a200>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 14:36:32.415  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gxc8b with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 14:36:32.430  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 14:36:32.561  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 14:36:32 GMT 2017]; root of context hierarchy\n2017-03-16 14:36:34.177  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 14:36:34.208  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 14:36:34.812  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 14:36:34.951  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.23]\n2017-03-16 14:36:34.951  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 14:36:34.963  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.23]:5701\n2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 14:36:35.410  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.23]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 14:36:36.323  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.23]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 14:36:36.596  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.23]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 14:36:36.597  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.23]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 14:36:36.607  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.23]:5701 [someGroup] [3.7.5] [10.180.1.23]:5701 is STARTING\n2017-03-16 14:36:36.608  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.23]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 14:36:36.634  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.23]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.23]:5701 - 59d5a498-0b91-4767-bfa7-67b983ad987a this\n}\n\n2017-03-16 14:36:36.706  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.23]:5701 [someGroup] [3.7.5] [10.180.1.23]:5701 is STARTED\n2017-03-16 14:36:36.715  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.341 seconds (JVM running for 6.19)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 14:36:32.415  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-gxc8b with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 14:36:32.430  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 14:36:32.561  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 14:36:32 GMT 2017]; root of context hierarchy
    2017-03-16 14:36:34.177  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 14:36:34.208  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 14:36:34.812  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 14:36:34.951  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.23]
    2017-03-16 14:36:34.951  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 14:36:34.963  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.23]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.23]:5701
    2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 14:36:34.998  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.23]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 14:36:35.410  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.23]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 14:36:36.323  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.23]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 14:36:36.596  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.23]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 14:36:36.597  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.23]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 14:36:36.607  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.23]:5701 [someGroup] [3.7.5] [10.180.1.23]:5701 is STARTING
    2017-03-16 14:36:36.608  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.23]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 14:36:36.634  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.23]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.23]:5701 - 59d5a498-0b91-4767-bfa7-67b983ad987a this
    }

    2017-03-16 14:36:36.706  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.23]:5701 [someGroup] [3.7.5] [10.180.1.23]:5701 is STARTED
    2017-03-16 14:36:36.715  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.341 seconds (JVM running for 6.19)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4209/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420b2b7b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 15:20:53.795  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wzlps with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 15:20:53.818  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 15:20:53.935  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 15:20:53 GMT 2017]; root of context hierarchy\n2017-03-16 15:20:55.761  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 15:20:55.781  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 15:20:56.404  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 15:20:56.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.11]\n2017-03-16 15:20:56.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 15:20:56.536  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 15:20:56.568  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.11]:5701\n2017-03-16 15:20:56.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 15:20:56.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 15:20:56.905  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.11]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 15:20:57.935  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 15:20:58.231  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 15:20:58.242  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 15:20:58.256  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTING\n2017-03-16 15:20:58.259  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 15:20:58.297  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.11]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.11]:5701 - 61c4a6d9-0cfb-4ff8-a372-bb066076a680 this\n}\n\n2017-03-16 15:20:58.375  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTED\n2017-03-16 15:20:58.379  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.598 seconds (JVM running for 6.505)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 15:20:53.795  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wzlps with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 15:20:53.818  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 15:20:53.935  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 15:20:53 GMT 2017]; root of context hierarchy
    2017-03-16 15:20:55.761  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 15:20:55.781  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 15:20:56.404  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 15:20:56.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.11]
    2017-03-16 15:20:56.523  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 15:20:56.536  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 15:20:56.568  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.11]:5701
    2017-03-16 15:20:56.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 15:20:56.569  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 15:20:56.905  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.11]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 15:20:57.935  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 15:20:58.231  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 15:20:58.242  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 15:20:58.256  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTING
    2017-03-16 15:20:58.259  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 15:20:58.297  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.11]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.11]:5701 - 61c4a6d9-0cfb-4ff8-a372-bb066076a680 this
    }

    2017-03-16 15:20:58.375  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.11]:5701 [someGroup] [3.7.5] [10.180.2.11]:5701 is STARTED
    2017-03-16 15:20:58.379  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.598 seconds (JVM running for 6.505)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420b2a790>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-gj3fp\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  15:40:55 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  15:40:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.14; broadcast_rpc_address=10.180.1.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gj3fp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  15:40:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  15:40:56 Global memtable on-heap threshold is enabled at 128MB\nINFO  15:40:56 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:40:56 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-gj3fp
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  15:40:55 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  15:40:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.14; broadcast_rpc_address=10.180.1.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gj3fp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  15:40:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  15:40:56 Global memtable on-heap threshold is enabled at 128MB
    INFO  15:40:56 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 15:40:56 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wfmjl] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420a0ae10 exit status 1 <nil> <nil> true [0xc4202c6210 0xc4202c6350 0xc4202c6368] [0xc4202c6210 0xc4202c6350 0xc4202c6368] [0xc4202c6330 0xc4202c6360] [0xc35000 0xc35000] 0xc420bfea80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wfmjl] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420a0ae10 exit status 1 <nil> <nil> true [0xc4202c6210 0xc4202c6350 0xc4202c6368] [0xc4202c6210 0xc4202c6350 0xc4202c6368] [0xc4202c6330 0xc4202c6360] [0xc35000 0xc35000] 0xc420bfea80 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4210/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421124a30>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-dp66l\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  16:26:38 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  16:26:38 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dp66l}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  16:26:38 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  16:26:38 Global memtable on-heap threshold is enabled at 128MB\nINFO  16:26:38 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 16:26:38 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-dp66l
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  16:26:38 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  16:26:38 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-dp66l}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  16:26:38 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  16:26:38 Global memtable on-heap threshold is enabled at 128MB
    INFO  16:26:38 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 16:26:38 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-64wtp] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c69dd0 exit status 1 <nil> <nil> true [0xc420036ae8 0xc420036b00 0xc420036b18] [0xc420036ae8 0xc420036b00 0xc420036b18] [0xc420036af8 0xc420036b10] [0xc35000 0xc35000] 0xc420da7d40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.192 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-64wtp] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420c69dd0 exit status 1 <nil> <nil> true [0xc420036ae8 0xc420036b00 0xc420036b18] [0xc420036ae8 0xc420036b00 0xc420036b18] [0xc420036af8 0xc420036b10] [0xc35000 0xc35000] 0xc420da7d40 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421f13130>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 16:31:59.772  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-lcwvh with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 16:31:59.786  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 16:31:59.878  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 16:31:59 GMT 2017]; root of context hierarchy\n2017-03-16 16:32:01.504  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 16:32:01.523  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 16:32:02.096  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 16:32:02.226  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-16 16:32:02.226  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 16:32:02.239  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 16:32:02.279  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-16 16:32:02.280  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 16:32:02.280  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 16:32:02.789  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 16:32:03.603  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 16:32:03.884  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 16:32:03.886  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 16:32:03.900  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-16 16:32:03.903  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 16:32:03.931  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - 83d6559e-2564-46a2-9833-ee93e777854b this\n}\n\n2017-03-16 16:32:03.983  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-16 16:32:03.999  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.201 seconds (JVM running for 6.124)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 16:31:59.772  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-lcwvh with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 16:31:59.786  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 16:31:59.878  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 16:31:59 GMT 2017]; root of context hierarchy
    2017-03-16 16:32:01.504  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 16:32:01.523  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 16:32:02.096  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 16:32:02.226  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
    2017-03-16 16:32:02.226  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 16:32:02.239  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 16:32:02.279  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
    2017-03-16 16:32:02.280  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 16:32:02.280  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 16:32:02.789  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 16:32:03.603  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 16:32:03.884  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 16:32:03.886  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 16:32:03.900  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
    2017-03-16 16:32:03.903  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 16:32:03.931  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.18]:5701 - 83d6559e-2564-46a2-9833-ee93e777854b this
    }

    2017-03-16 16:32:03.983  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
    2017-03-16 16:32:03.999  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.201 seconds (JVM running for 6.124)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4211/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42180b4f0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.19\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.19\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.19\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.19\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-d3p7j\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  17:44:11 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  17:44:12 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.19; broadcast_rpc_address=10.180.1.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-d3p7j}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  17:44:12 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  17:44:12 Global memtable on-heap threshold is enabled at 128MB\nINFO  17:44:12 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:44:12 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.19
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.19
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.19
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.19
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-d3p7j
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  17:44:11 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  17:44:12 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.19; broadcast_rpc_address=10.180.1.19; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.19; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-d3p7j}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  17:44:12 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  17:44:12 Global memtable on-heap threshold is enabled at 128MB
    INFO  17:44:12 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 17:44:12 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7t64h] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421523140 exit status 1 <nil> <nil> true [0xc4205b4260 0xc4205b42a8 0xc4205b42d8] [0xc4205b4260 0xc4205b42a8 0xc4205b42d8] [0xc4205b42a0 0xc4205b42c8] [0xc35000 0xc35000] 0xc4211603c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7t64h] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421523140 exit status 1 <nil> <nil> true [0xc4205b4260 0xc4205b42a8 0xc4205b42d8] [0xc4205b4260 0xc4205b42a8 0xc4205b42d8] [0xc4205b42a0 0xc4205b42c8] [0xc35000 0xc35000] 0xc4211603c0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420f66740>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 17:24:18.963  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-sctgs with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 17:24:18.971  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 17:24:19.134  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 17:24:19 GMT 2017]; root of context hierarchy\n2017-03-16 17:24:20.831  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 17:24:20.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 17:24:21.639  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 17:24:21.755  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.15]\n2017-03-16 17:24:21.755  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 17:24:21.767  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 17:24:21.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.15]:5701\n2017-03-16 17:24:21.801  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 17:24:21.801  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 17:24:22.170  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 17:24:23.093  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 17:24:23.412  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 17:24:23.422  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 17:24:23.435  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.15]:5701 [someGroup] [3.7.5] [10.180.0.15]:5701 is STARTING\n2017-03-16 17:24:23.438  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 17:24:23.496  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.0.15]:5701 - 8ba46f5b-dc8b-4ab2-ad88-c63e302c0541 this\n}\n\n2017-03-16 17:24:23.579  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.15]:5701 [someGroup] [3.7.5] [10.180.0.15]:5701 is STARTED\n2017-03-16 17:24:23.581  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.786 seconds (JVM running for 6.612)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 17:24:18.963  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-sctgs with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 17:24:18.971  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 17:24:19.134  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 17:24:19 GMT 2017]; root of context hierarchy
    2017-03-16 17:24:20.831  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 17:24:20.856  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 17:24:21.639  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 17:24:21.755  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.15]
    2017-03-16 17:24:21.755  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 17:24:21.767  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 17:24:21.800  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.15]:5701
    2017-03-16 17:24:21.801  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 17:24:21.801  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 17:24:22.170  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 17:24:23.093  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 17:24:23.412  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 17:24:23.422  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 17:24:23.435  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.15]:5701 [someGroup] [3.7.5] [10.180.0.15]:5701 is STARTING
    2017-03-16 17:24:23.438  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 17:24:23.496  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.15]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.0.15]:5701 - 8ba46f5b-dc8b-4ab2-ad88-c63e302c0541 this
    }

    2017-03-16 17:24:23.579  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.15]:5701 [someGroup] [3.7.5] [10.180.0.15]:5701 is STARTED
    2017-03-16 17:24:23.581  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.786 seconds (JVM running for 6.612)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4212/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4209c18e0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-7pzbn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:19:26 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:19:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7pzbn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:19:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:19:26 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:19:26 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:19:26 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-7pzbn
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  18:19:26 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:19:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.8; broadcast_rpc_address=10.180.1.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-7pzbn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:19:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:19:26 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:19:26 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:19:26 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-blg5s] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42117f260 exit status 1 <nil> <nil> true [0xc4205923e0 0xc4205923f8 0xc420592410] [0xc4205923e0 0xc4205923f8 0xc420592410] [0xc4205923f0 0xc420592408] [0xc360d0 0xc360d0] 0xc420fe9620 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-blg5s] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42117f260 exit status 1 <nil> <nil> true [0xc4205923e0 0xc4205923f8 0xc420592410] [0xc4205923e0 0xc4205923f8 0xc420592410] [0xc4205923f0 0xc420592408] [0xc360d0 0xc360d0] 0xc420fe9620 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42207ac70>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 18:36:38.045  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bx36p with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 18:36:38.057  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 18:36:38.200  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 18:36:38 GMT 2017]; root of context hierarchy\n2017-03-16 18:36:39.880  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 18:36:39.901  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 18:36:40.690  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 18:36:40.805  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.19]\n2017-03-16 18:36:40.806  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 18:36:40.821  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.19]:5701\n2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 18:36:41.259  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.19]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 18:36:42.140  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 18:36:42.484  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 18:36:42.492  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 18:36:42.503  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTING\n2017-03-16 18:36:42.512  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 18:36:42.544  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.19]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.19]:5701 - 882980fa-eabe-4add-895b-88706a047df1 this\n}\n\n2017-03-16 18:36:42.605  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTED\n2017-03-16 18:36:42.636  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.581 seconds (JVM running for 8.99)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 18:36:38.045  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bx36p with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 18:36:38.057  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 18:36:38.200  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 18:36:38 GMT 2017]; root of context hierarchy
    2017-03-16 18:36:39.880  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 18:36:39.901  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 18:36:40.690  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 18:36:40.805  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.19]
    2017-03-16 18:36:40.806  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 18:36:40.821  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.19]:5701
    2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 18:36:40.862  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 18:36:41.259  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.19]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 18:36:42.140  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 18:36:42.484  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 18:36:42.492  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 18:36:42.503  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTING
    2017-03-16 18:36:42.512  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 18:36:42.544  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.19]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.19]:5701 - 882980fa-eabe-4add-895b-88706a047df1 this
    }

    2017-03-16 18:36:42.605  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.19]:5701 [someGroup] [3.7.5] [10.180.1.19]:5701 is STARTED
    2017-03-16 18:36:42.636  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.581 seconds (JVM running for 8.99)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4213/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42212c730>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 19:24:29.691  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-djbvz with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 19:24:29.698  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 19:24:29.803  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 19:24:29 GMT 2017]; root of context hierarchy\n2017-03-16 19:24:31.452  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 19:24:31.470  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 19:24:32.111  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 19:24:32.238  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.12]\n2017-03-16 19:24:32.239  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 19:24:32.251  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 19:24:32.284  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.12]:5701\n2017-03-16 19:24:32.284  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 19:24:32.285  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 19:24:32.632  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.12]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 19:24:33.612  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 19:24:33.889  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 19:24:33.899  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 19:24:33.908  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTING\n2017-03-16 19:24:33.911  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 19:24:33.934  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.12]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.12]:5701 - 0dc372e6-d7ff-475a-b39e-343bb1f3d8c6 this\n}\n\n2017-03-16 19:24:34.004  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTED\n2017-03-16 19:24:34.008  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.192 seconds (JVM running for 6.1)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 19:24:29.691  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-djbvz with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 19:24:29.698  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 19:24:29.803  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 19:24:29 GMT 2017]; root of context hierarchy
    2017-03-16 19:24:31.452  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 19:24:31.470  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 19:24:32.111  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 19:24:32.238  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.12]
    2017-03-16 19:24:32.239  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 19:24:32.251  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 19:24:32.284  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.12]:5701
    2017-03-16 19:24:32.284  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 19:24:32.285  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 19:24:32.632  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.12]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 19:24:33.612  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 19:24:33.889  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 19:24:33.899  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 19:24:33.908  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTING
    2017-03-16 19:24:33.911  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 19:24:33.934  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.12]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.12]:5701 - 0dc372e6-d7ff-475a-b39e-343bb1f3d8c6 this
    }

    2017-03-16 19:24:34.004  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.12]:5701 [someGroup] [3.7.5] [10.180.2.12]:5701 is STARTED
    2017-03-16 19:24:34.008  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.192 seconds (JVM running for 6.1)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-468qk] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4216cd050 exit status 1 <nil> <nil> true [0xc420037548 0xc420037560 0xc420037578] [0xc420037548 0xc420037560 0xc420037578] [0xc420037558 0xc420037570] [0xc360d0 0xc360d0] 0xc42123fc20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-468qk] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4216cd050 exit status 1 <nil> <nil> true [0xc420037548 0xc420037560 0xc420037578] [0xc420037548 0xc420037560 0xc420037578] [0xc420037558 0xc420037570] [0xc360d0 0xc360d0] 0xc42123fc20 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4216081b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-66mjq\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  19:21:36 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  19:21:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-66mjq}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  19:21:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  19:21:36 Global memtable on-heap threshold is enabled at 128MB\nINFO  19:21:36 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 19:21:36 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-66mjq
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  19:21:36 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  19:21:36 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.10; broadcast_rpc_address=10.180.2.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-66mjq}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  19:21:36 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  19:21:36 Global memtable on-heap threshold is enabled at 128MB
    INFO  19:21:36 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 19:21:36 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4214/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42190c820>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.0.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.0.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.0.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-9dcns\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  20:37:43 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  20:37:43 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.11; broadcast_rpc_address=10.180.0.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9dcns}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  20:37:43 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  20:37:43 Global memtable on-heap threshold is enabled at 128MB\nINFO  20:37:43 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 20:37:43 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.0.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.0.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.0.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.0.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-9dcns
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  20:37:43 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  20:37:43 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.0.11; broadcast_rpc_address=10.180.0.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.0.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9dcns}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  20:37:43 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  20:37:43 Global memtable on-heap threshold is enabled at 128MB
    INFO  20:37:43 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 20:37:43 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jxt8z] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4213347e0 exit status 1 <nil> <nil> true [0xc42054e6d8 0xc42054e6f0 0xc42054e708] [0xc42054e6d8 0xc42054e6f0 0xc42054e708] [0xc42054e6e8 0xc42054e700] [0xc360d0 0xc360d0] 0xc421050fc0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jxt8z] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4213347e0 exit status 1 <nil> <nil> true [0xc42054e6d8 0xc42054e6f0 0xc42054e708] [0xc42054e6d8 0xc42054e6f0 0xc42054e708] [0xc42054e6e8 0xc42054e700] [0xc360d0 0xc360d0] 0xc421050fc0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421078800>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 20:22:33.809  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9r0hb with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 20:22:33.826  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 20:22:33.991  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 20:22:33 GMT 2017]; root of context hierarchy\n2017-03-16 20:22:35.735  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 20:22:35.760  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 20:22:36.585  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 20:22:36.733  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]\n2017-03-16 20:22:36.733  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 20:22:36.745  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701\n2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 20:22:37.152  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 20:22:38.161  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 20:22:38.429  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 20:22:38.434  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 20:22:38.462  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING\n2017-03-16 20:22:38.463  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 20:22:38.497  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.15]:5701 - f03b4406-e5bc-46ae-a5de-42448e37ab1b this\n}\n\n2017-03-16 20:22:38.553  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED\n2017-03-16 20:22:38.565  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.938 seconds (JVM running for 6.785)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 20:22:33.809  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9r0hb with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 20:22:33.826  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 20:22:33.991  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 20:22:33 GMT 2017]; root of context hierarchy
    2017-03-16 20:22:35.735  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 20:22:35.760  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 20:22:36.585  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 20:22:36.733  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]
    2017-03-16 20:22:36.733  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 20:22:36.745  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701
    2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 20:22:36.781  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 20:22:37.152  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 20:22:38.161  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 20:22:38.429  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 20:22:38.434  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 20:22:38.462  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING
    2017-03-16 20:22:38.463  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 20:22:38.497  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.15]:5701 - f03b4406-e5bc-46ae-a5de-42448e37ab1b this
    }

    2017-03-16 20:22:38.553  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED
    2017-03-16 20:22:38.565  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.938 seconds (JVM running for 6.785)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4215/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421992870>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.15\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.15\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.15\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3jdbm\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  21:33:42 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  21:33:43 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3jdbm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  21:33:43 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  21:33:43 Global memtable on-heap threshold is enabled at 128MB\nINFO  21:33:43 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 21:33:43 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.15
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.15
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.15
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.15
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3jdbm
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  21:33:42 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  21:33:43 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.15; broadcast_rpc_address=10.180.3.15; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.15; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3jdbm}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  21:33:43 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  21:33:43 Global memtable on-heap threshold is enabled at 128MB
    INFO  21:33:43 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 21:33:43 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nq6n3] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ae6e10 exit status 1 <nil> <nil> true [0xc420e3e3f0 0xc420e3e408 0xc420e3e420] [0xc420e3e3f0 0xc420e3e408 0xc420e3e420] [0xc420e3e400 0xc420e3e418] [0xc360d0 0xc360d0] 0xc420be40c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nq6n3] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ae6e10 exit status 1 <nil> <nil> true [0xc420e3e3f0 0xc420e3e408 0xc420e3e420] [0xc420e3e3f0 0xc420e3e408 0xc420e3e420] [0xc420e3e400 0xc420e3e418] [0xc360d0 0xc360d0] 0xc420be40c0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420d77170>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 21:18:41.525  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0904p with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-16 21:18:41.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 21:18:41.601  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 21:18:41 GMT 2017]; root of context hierarchy\n2017-03-16 21:18:43.098  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 21:18:43.122  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 21:18:43.706  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 21:18:43.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-16 21:18:43.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 21:18:43.825  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 21:18:44.176  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 21:18:44.934  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 21:18:45.169  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 21:18:45.172  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 21:18:45.182  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-16 21:18:45.185  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 21:18:45.215  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - 1990fd58-2d11-4980-af58-71f4bce23619 this\n}\n\n2017-03-16 21:18:45.301  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-16 21:18:45.303  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.811 seconds (JVM running for 5.636)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 21:18:41.525  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-0904p with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-16 21:18:41.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 21:18:41.601  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 21:18:41 GMT 2017]; root of context hierarchy
    2017-03-16 21:18:43.098  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 21:18:43.122  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 21:18:43.706  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 21:18:43.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
    2017-03-16 21:18:43.813  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 21:18:43.825  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
    2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 21:18:43.865  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 21:18:44.176  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 21:18:44.934  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 21:18:45.169  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 21:18:45.172  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 21:18:45.182  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
    2017-03-16 21:18:45.185  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 21:18:45.215  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.14]:5701 - 1990fd58-2d11-4980-af58-71f4bce23619 this
    }

    2017-03-16 21:18:45.301  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
    2017-03-16 21:18:45.303  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.811 seconds (JVM running for 5.636)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4216/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421be8620>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.18\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.18\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.18\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.18\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-vtwzp\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  22:40:03 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  22:40:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.18; broadcast_rpc_address=10.180.3.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vtwzp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  22:40:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  22:40:03 Global memtable on-heap threshold is enabled at 128MB\nINFO  22:40:03 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 22:40:03 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.18
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.18
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.18
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.18
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-vtwzp
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  22:40:03 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  22:40:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.18; broadcast_rpc_address=10.180.3.18; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.18; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-vtwzp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  22:40:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  22:40:03 Global memtable on-heap threshold is enabled at 128MB
    INFO  22:40:03 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 22:40:03 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5l9w2] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4210508d0 exit status 1 <nil> <nil> true [0xc420038530 0xc420038568 0xc4200385b0] [0xc420038530 0xc420038568 0xc4200385b0] [0xc420038548 0xc4200385a0] [0xc360d0 0xc360d0] 0xc4212570e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5l9w2] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4210508d0 exit status 1 <nil> <nil> true [0xc420038530 0xc420038568 0xc4200385b0] [0xc420038530 0xc420038568 0xc4200385b0] [0xc420038548 0xc4200385a0] [0xc360d0 0xc360d0] 0xc4212570e0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421b37740>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 22:25:16.230  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-f5qfv with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-16 22:25:16.238  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 22:25:16.371  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 22:25:16 GMT 2017]; root of context hierarchy\n2017-03-16 22:25:17.967  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 22:25:17.988  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 22:25:18.810  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 22:25:18.940  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.17]\n2017-03-16 22:25:18.941  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 22:25:18.953  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 22:25:18.984  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.17]:5701\n2017-03-16 22:25:18.984  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 22:25:18.985  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 22:25:19.321  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 22:25:20.255  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.3.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 22:25:20.544  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 22:25:20.546  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 22:25:20.560  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTING\n2017-03-16 22:25:20.562  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 22:25:20.599  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.17]:5701 - c869a394-6eca-4270-a884-12dbebb0225b this\n}\n\n2017-03-16 22:25:20.667  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTED\n2017-03-16 22:25:20.670  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.329 seconds (JVM running for 6.317)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 22:25:16.230  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-f5qfv with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-16 22:25:16.238  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 22:25:16.371  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 22:25:16 GMT 2017]; root of context hierarchy
    2017-03-16 22:25:17.967  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 22:25:17.988  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 22:25:18.810  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 22:25:18.940  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.17]
    2017-03-16 22:25:18.941  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 22:25:18.953  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 22:25:18.984  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.17]:5701
    2017-03-16 22:25:18.984  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 22:25:18.985  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 22:25:19.321  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 22:25:20.255  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.3.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 22:25:20.544  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 22:25:20.546  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 22:25:20.560  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTING
    2017-03-16 22:25:20.562  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 22:25:20.599  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.17]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.17]:5701 - c869a394-6eca-4270-a884-12dbebb0225b this
    }

    2017-03-16 22:25:20.667  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTED
    2017-03-16 22:25:20.670  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.329 seconds (JVM running for 6.317)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4217/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b49fq] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4213af140 exit status 1 <nil> <nil> true [0xc420036268 0xc420036280 0xc420036298] [0xc420036268 0xc420036280 0xc420036298] [0xc420036278 0xc420036290] [0xc35e70 0xc35e70] 0xc422359980 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b49fq] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4213af140 exit status 1 <nil> <nil> true [0xc420036268 0xc420036280 0xc420036298] [0xc420036268 0xc420036280 0xc420036298] [0xc420036278 0xc420036290] [0xc35e70 0xc35e70] 0xc422359980 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420ce50d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-16 23:14:33.448  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5rzjg with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-16 23:14:33.455  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-16 23:14:33.635  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 23:14:33 GMT 2017]; root of context hierarchy\n2017-03-16 23:14:35.433  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-16 23:14:35.460  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-16 23:14:36.103  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-16 23:14:36.220  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]\n2017-03-16 23:14:36.220  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-16 23:14:36.233  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-16 23:14:36.265  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701\n2017-03-16 23:14:36.265  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-16 23:14:36.266  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-16 23:14:36.635  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-16 23:14:37.492  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-16 23:14:37.779  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-16 23:14:37.791  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-16 23:14:37.818  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING\n2017-03-16 23:14:37.819  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-16 23:14:37.844  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.6]:5701 - 3a8b3590-26c7-4a4e-a2af-6c354c52b1be this\n}\n\n2017-03-16 23:14:37.919  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED\n2017-03-16 23:14:37.924  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.539 seconds (JVM running for 6.399)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-16 23:14:33.448  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-5rzjg with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-16 23:14:33.455  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-16 23:14:33.635  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Thu Mar 16 23:14:33 GMT 2017]; root of context hierarchy
    2017-03-16 23:14:35.433  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-16 23:14:35.460  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-16 23:14:36.103  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-16 23:14:36.220  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.6]
    2017-03-16 23:14:36.220  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-16 23:14:36.233  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-16 23:14:36.265  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.6]:5701
    2017-03-16 23:14:36.265  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-16 23:14:36.266  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-16 23:14:36.635  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-16 23:14:37.492  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-16 23:14:37.779  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-16 23:14:37.791  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-16 23:14:37.818  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTING
    2017-03-16 23:14:37.819  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-16 23:14:37.844  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.6]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.6]:5701 - 3a8b3590-26c7-4a4e-a2af-6c354c52b1be this
    }

    2017-03-16 23:14:37.919  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.6]:5701 [someGroup] [3.7.5] [10.180.3.6]:5701 is STARTED
    2017-03-16 23:14:37.924  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.539 seconds (JVM running for 6.399)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4212dd2b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.17\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.17\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.17\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.17\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-9z7mj\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  23:41:20 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  23:41:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.17; broadcast_rpc_address=10.180.2.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9z7mj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  23:41:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  23:41:21 Global memtable on-heap threshold is enabled at 128MB\nINFO  23:41:21 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 23:41:21 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.17
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.17
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.17
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.17
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-9z7mj
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  23:41:20 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  23:41:20 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.17; broadcast_rpc_address=10.180.2.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9z7mj}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  23:41:20 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  23:41:21 Global memtable on-heap threshold is enabled at 128MB
    INFO  23:41:21 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 23:41:21 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4218/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420ce4bb0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 00:27:19.880  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-2vmqc with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-17 00:27:19.904  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 00:27:20.062  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 00:27:20 GMT 2017]; root of context hierarchy\n2017-03-17 00:27:21.883  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 00:27:21.903  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 00:27:22.518  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 00:27:22.643  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.17]\n2017-03-17 00:27:22.643  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 00:27:22.656  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 00:27:22.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.17]:5701\n2017-03-17 00:27:22.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 00:27:22.690  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 00:27:23.031  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.17]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 00:27:23.994  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 00:27:24.318  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 00:27:24.322  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 00:27:24.330  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTING\n2017-03-17 00:27:24.335  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 00:27:24.384  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.17]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.17]:5701 - 83bd78a7-8497-417d-b039-3f592c265323 this\n}\n\n2017-03-17 00:27:24.464  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTED\n2017-03-17 00:27:24.469  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.547 seconds (JVM running for 6.564)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 00:27:19.880  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-2vmqc with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-17 00:27:19.904  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 00:27:20.062  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 00:27:20 GMT 2017]; root of context hierarchy
    2017-03-17 00:27:21.883  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 00:27:21.903  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 00:27:22.518  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 00:27:22.643  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.17]
    2017-03-17 00:27:22.643  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 00:27:22.656  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.17]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 00:27:22.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.17]:5701
    2017-03-17 00:27:22.689  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 00:27:22.690  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.17]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 00:27:23.031  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.17]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 00:27:23.994  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.17]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 00:27:24.318  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 00:27:24.322  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.17]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 00:27:24.330  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTING
    2017-03-17 00:27:24.335  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.17]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 00:27:24.384  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.17]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.17]:5701 - 83bd78a7-8497-417d-b039-3f592c265323 this
    }

    2017-03-17 00:27:24.464  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.17]:5701 [someGroup] [3.7.5] [10.180.3.17]:5701 is STARTED
    2017-03-17 00:27:24.469  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.547 seconds (JVM running for 6.564)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420773b50>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.20\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.20\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.20\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.20\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-5fsgt\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  00:44:59 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  00:44:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.20; broadcast_rpc_address=10.180.3.20; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.20; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5fsgt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  00:44:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  00:45:00 Global memtable on-heap threshold is enabled at 128MB\nINFO  00:45:00 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 00:45:00 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.20
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.20
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.20
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.20
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-5fsgt
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  00:44:59 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  00:44:59 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.20; broadcast_rpc_address=10.180.3.20; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.20; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5fsgt}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  00:44:59 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  00:45:00 Global memtable on-heap threshold is enabled at 128MB
    INFO  00:45:00 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 00:45:00 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tk5rc] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ea3980 exit status 1 <nil> <nil> true [0xc420498540 0xc420498570 0xc420498598] [0xc420498540 0xc420498570 0xc420498598] [0xc420498560 0xc420498588] [0xc35e70 0xc35e70] 0xc4212cfc80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.149.116 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-tk5rc] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ea3980 exit status 1 <nil> <nil> true [0xc420498540 0xc420498570 0xc420498598] [0xc420498540 0xc420498570 0xc420498598] [0xc420498560 0xc420498588] [0xc35e70 0xc35e70] 0xc4212cfc80 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4219/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421c8a7a0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 01:25:20.064  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bj59v with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-17 01:25:20.072  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 01:25:20.187  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 01:25:20 GMT 2017]; root of context hierarchy\n2017-03-17 01:25:22.035  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 01:25:22.062  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 01:25:22.809  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 01:25:22.941  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-17 01:25:22.942  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 01:25:22.954  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 01:25:22.987  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-17 01:25:22.988  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 01:25:22.988  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 01:25:23.384  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 01:25:24.324  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 01:25:24.621  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 01:25:24.632  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 01:25:24.645  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-17 01:25:24.649  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 01:25:24.673  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - dd912a5f-8195-4137-a8e0-4b434267ab41 this\n}\n\n2017-03-17 01:25:24.779  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-17 01:25:24.782  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.824 seconds (JVM running for 6.751)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 01:25:20.064  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-bj59v with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-17 01:25:20.072  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 01:25:20.187  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 01:25:20 GMT 2017]; root of context hierarchy
    2017-03-17 01:25:22.035  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 01:25:22.062  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 01:25:22.809  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 01:25:22.941  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
    2017-03-17 01:25:22.942  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 01:25:22.954  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 01:25:22.987  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
    2017-03-17 01:25:22.988  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 01:25:22.988  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 01:25:23.384  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 01:25:24.324  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 01:25:24.621  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 01:25:24.632  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 01:25:24.645  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
    2017-03-17 01:25:24.649  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 01:25:24.673  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.16]:5701 - dd912a5f-8195-4137-a8e0-4b434267ab41 this
    }

    2017-03-17 01:25:24.779  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
    2017-03-17 01:25:24.782  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.824 seconds (JVM running for 6.751)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421cee8b0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.17\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.17\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.17\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.17\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-0j7h5\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  01:40:28 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  01:40:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.17; broadcast_rpc_address=10.180.1.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0j7h5}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  01:40:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  01:40:28 Global memtable on-heap threshold is enabled at 128MB\nINFO  01:40:28 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:40:28 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.17
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.17
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.17
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.17
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-0j7h5
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  01:40:28 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  01:40:28 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.17; broadcast_rpc_address=10.180.1.17; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.17; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-0j7h5}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  01:40:28 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  01:40:28 Global memtable on-heap threshold is enabled at 128MB
    INFO  01:40:28 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 01:40:28 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.63.79 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gc9kl] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42127a480 exit status 1 <nil> <nil> true [0xc4204901b0 0xc4204901c8 0xc4204901e8] [0xc4204901b0 0xc4204901c8 0xc4204901e8] [0xc4204901c0 0xc4204901d8] [0xc35e70 0xc35e70] 0xc4212bac00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.63.79 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-gc9kl] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42127a480 exit status 1 <nil> <nil> true [0xc4204901b0 0xc4204901c8 0xc4204901e8] [0xc4204901b0 0xc4204901c8 0xc4204901e8] [0xc4204901c0 0xc4204901d8] [0xc35e70 0xc35e70] 0xc4212bac00 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

ethernetdan commented 7 years ago

Fixes are in the works (#43243) but I don't think we should block for this job.

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4220/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.63.79 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-4llnt] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4222a7470 exit status 1 <nil> <nil> true [0xc42052a070 0xc42052a1f0 0xc42052a210] [0xc42052a070 0xc42052a1f0 0xc42052a210] [0xc42052a100 0xc42052a200] [0xc35e70 0xc35e70] 0xc4218f2780 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.63.79 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-4llnt] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4222a7470 exit status 1 <nil> <nil> true [0xc42052a070 0xc42052a1f0 0xc42052a210] [0xc42052a070 0xc42052a1f0 0xc42052a210] [0xc42052a100 0xc42052a200] [0xc35e70 0xc35e70] 0xc4218f2780 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420e75170>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 02:15:04.511  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-jmtml with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-17 02:15:04.530  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 02:15:04.629  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@69663380: startup date [Fri Mar 17 02:15:04 GMT 2017]; root of context hierarchy\n2017-03-17 02:15:06.089  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 02:15:06.104  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 02:15:06.668  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 02:15:06.790  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]\n2017-03-17 02:15:06.790  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 02:15:06.800  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 02:15:06.831  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701\n2017-03-17 02:15:06.831  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 02:15:06.831  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 02:15:07.162  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 02:15:08.037  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 02:15:08.306  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 02:15:08.317  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 02:15:08.338  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING\n2017-03-17 02:15:08.342  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 02:15:08.371  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.9]:5701 - 6d0c826f-e4ab-4b66-b26a-ce8ab6c33a88 this\n}\n\n2017-03-17 02:15:08.422  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED\n2017-03-17 02:15:08.425  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.84 seconds (JVM running for 5.615)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 02:15:04.511  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-jmtml with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-17 02:15:04.530  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 02:15:04.629  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@69663380: startup date [Fri Mar 17 02:15:04 GMT 2017]; root of context hierarchy
    2017-03-17 02:15:06.089  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 02:15:06.104  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 02:15:06.668  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 02:15:06.790  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]
    2017-03-17 02:15:06.790  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 02:15:06.800  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 02:15:06.831  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701
    2017-03-17 02:15:06.831  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 02:15:06.831  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 02:15:07.162  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 02:15:08.037  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 02:15:08.306  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 02:15:08.317  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 02:15:08.338  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING
    2017-03-17 02:15:08.342  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 02:15:08.371  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.9]:5701 - 6d0c826f-e4ab-4b66-b26a-ce8ab6c33a88 this
    }

    2017-03-17 02:15:08.422  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED
    2017-03-17 02:15:08.425  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.84 seconds (JVM running for 5.615)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421e42e80>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-mc0ss\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  02:40:24 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  02:40:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.9; broadcast_rpc_address=10.180.3.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-mc0ss}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  02:40:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  02:40:24 Global memtable on-heap threshold is enabled at 128MB\nINFO  02:40:24 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 02:40:24 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-mc0ss
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  02:40:24 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  02:40:24 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.9; broadcast_rpc_address=10.180.3.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-mc0ss}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  02:40:24 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  02:40:24 Global memtable on-heap threshold is enabled at 128MB
    INFO  02:40:24 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 02:40:24 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4221/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421059520>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-9msx1\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  03:24:58 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  03:24:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.12; broadcast_rpc_address=10.180.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9msx1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  03:24:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  03:24:58 Global memtable on-heap threshold is enabled at 128MB\nINFO  03:24:58 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 03:24:58 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-9msx1
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  03:24:58 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  03:24:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.12; broadcast_rpc_address=10.180.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9msx1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  03:24:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  03:24:58 Global memtable on-heap threshold is enabled at 128MB
    INFO  03:24:58 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 03:24:58 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420dd6d50>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 03:32:02.212  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-67rzr with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 03:32:02.229  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 03:32:02.316  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 03:32:02 GMT 2017]; root of context hierarchy\n2017-03-17 03:32:04.185  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 03:32:04.222  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 03:32:04.909  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 03:32:05.064  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-17 03:32:05.064  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 03:32:05.075  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 03:32:05.109  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-17 03:32:05.109  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 03:32:05.109  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 03:32:05.444  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 03:32:06.290  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 03:32:06.580  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 03:32:06.587  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 03:32:06.617  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-17 03:32:06.619  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 03:32:06.667  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - 283b12cb-a4cf-49b0-a911-be99f913465e this\n}\n\n2017-03-17 03:32:06.740  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-17 03:32:06.746  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.592 seconds (JVM running for 6.475)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 03:32:02.212  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-67rzr with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 03:32:02.229  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 03:32:02.316  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 03:32:02 GMT 2017]; root of context hierarchy
    2017-03-17 03:32:04.185  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 03:32:04.222  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 03:32:04.909  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 03:32:05.064  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
    2017-03-17 03:32:05.064  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 03:32:05.075  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 03:32:05.109  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
    2017-03-17 03:32:05.109  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 03:32:05.109  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 03:32:05.444  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 03:32:06.290  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 03:32:06.580  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 03:32:06.587  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 03:32:06.617  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
    2017-03-17 03:32:06.619  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 03:32:06.667  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.18]:5701 - 283b12cb-a4cf-49b0-a911-be99f913465e this
    }

    2017-03-17 03:32:06.740  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
    2017-03-17 03:32:06.746  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.592 seconds (JVM running for 6.475)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.161.133 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xw08w] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421d5d830 exit status 1 <nil> <nil> true [0xc4207642b8 0xc4207642d0 0xc4207642e8] [0xc4207642b8 0xc4207642d0 0xc4207642e8] [0xc4207642c8 0xc4207642e0] [0xc35e70 0xc35e70] 0xc420c5a720 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.161.133 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-xw08w] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421d5d830 exit status 1 <nil> <nil> true [0xc4207642b8 0xc4207642d0 0xc4207642e8] [0xc4207642b8 0xc4207642d0 0xc4207642e8] [0xc4207642c8 0xc4207642e0] [0xc35e70 0xc35e70] 0xc420c5a720 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4222/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4220e7810>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 04:29:21.642  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wqprk with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 04:29:21.664  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 04:29:21.792  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 04:29:21 GMT 2017]; root of context hierarchy\n2017-03-17 04:29:23.726  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 04:29:23.750  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 04:29:24.380  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 04:29:24.494  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.8]\n2017-03-17 04:29:24.494  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 04:29:24.505  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 04:29:24.538  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.8]:5701\n2017-03-17 04:29:24.538  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 04:29:24.539  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 04:29:24.867  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 04:29:25.738  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 04:29:26.026  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 04:29:26.041  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 04:29:26.053  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTING\n2017-03-17 04:29:26.056  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 04:29:26.084  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.8]:5701 - c0abc6a6-8b5d-4539-8784-3bc204a0c182 this\n}\n\n2017-03-17 04:29:26.146  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTED\n2017-03-17 04:29:26.155  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.636 seconds (JVM running for 6.569)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 04:29:21.642  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-wqprk with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 04:29:21.664  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 04:29:21.792  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 04:29:21 GMT 2017]; root of context hierarchy
    2017-03-17 04:29:23.726  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 04:29:23.750  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 04:29:24.380  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 04:29:24.494  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.8]
    2017-03-17 04:29:24.494  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 04:29:24.505  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 04:29:24.538  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.8]:5701
    2017-03-17 04:29:24.538  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 04:29:24.539  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 04:29:24.867  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 04:29:25.738  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 04:29:26.026  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 04:29:26.041  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 04:29:26.053  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTING
    2017-03-17 04:29:26.056  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 04:29:26.084  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.8]:5701 - c0abc6a6-8b5d-4539-8784-3bc204a0c182 this
    }

    2017-03-17 04:29:26.146  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTED
    2017-03-17 04:29:26.155  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.636 seconds (JVM running for 6.569)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.161.133 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-n5wvn] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420ebf260 exit status 1 <nil> <nil> true [0xc4200386c8 0xc4200386e0 0xc420038708] [0xc4200386c8 0xc4200386e0 0xc420038708] [0xc4200386d8 0xc4200386f8] [0xc35e70 0xc35e70] 0xc4208356e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.161.133 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-n5wvn] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420ebf260 exit status 1 <nil> <nil> true [0xc4200386c8 0xc4200386e0 0xc420038708] [0xc4200386c8 0xc4200386e0 0xc420038708] [0xc4200386d8 0xc4200386f8] [0xc35e70 0xc35e70] 0xc4208356e0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420b53ee0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.5\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.5\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.5\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.5\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-c2w5p\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  04:24:15 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  04:24:16 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.5; broadcast_rpc_address=10.180.2.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-c2w5p}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  04:24:16 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  04:24:16 Global memtable on-heap threshold is enabled at 128MB\nINFO  04:24:16 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 04:24:16 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.5
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.5
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.5
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.5
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-c2w5p
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  04:24:15 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  04:24:16 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.5; broadcast_rpc_address=10.180.2.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-c2w5p}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  04:24:16 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  04:24:16 Global memtable on-heap threshold is enabled at 128MB
    INFO  04:24:16 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 04:24:16 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4223/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420c7b160>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-4rh00\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  05:26:09 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  05:26:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4rh00}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  05:26:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  05:26:09 Global memtable on-heap threshold is enabled at 128MB\nINFO  05:26:09 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 05:26:09 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-4rh00
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  05:26:09 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  05:26:09 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.7; broadcast_rpc_address=10.180.1.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4rh00}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  05:26:09 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  05:26:09 Global memtable on-heap threshold is enabled at 128MB
    INFO  05:26:09 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 05:26:09 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5hm71] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4220d7aa0 exit status 1 <nil> <nil> true [0xc4205aa358 0xc4205aa380 0xc4205aa3a0] [0xc4205aa358 0xc4205aa380 0xc4205aa3a0] [0xc4205aa370 0xc4205aa398] [0xc35e70 0xc35e70] 0xc421351080 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-5hm71] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4220d7aa0 exit status 1 <nil> <nil> true [0xc4205aa358 0xc4205aa380 0xc4205aa3a0] [0xc4205aa358 0xc4205aa380 0xc4205aa3a0] [0xc4205aa370 0xc4205aa398] [0xc35e70 0xc35e70] 0xc421351080 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421ed8770>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 05:29:07.598  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-k9bd6 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 05:29:07.606  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 05:29:07.857  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 05:29:07 GMT 2017]; root of context hierarchy\n2017-03-17 05:29:09.729  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 05:29:09.754  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 05:29:10.518  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 05:29:10.687  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.8]\n2017-03-17 05:29:10.688  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 05:29:10.707  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 05:29:10.741  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701\n2017-03-17 05:29:10.741  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 05:29:10.742  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 05:29:11.113  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 05:29:12.036  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 05:29:12.335  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 05:29:12.339  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 05:29:12.349  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING\n2017-03-17 05:29:12.352  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 05:29:12.392  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.8]:5701 - 296401a1-2d9a-41dc-9c20-e6ba2c1cc411 this\n}\n\n2017-03-17 05:29:12.470  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED\n2017-03-17 05:29:12.473  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.903 seconds (JVM running for 6.785)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 05:29:07.598  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-k9bd6 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 05:29:07.606  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 05:29:07.857  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 05:29:07 GMT 2017]; root of context hierarchy
    2017-03-17 05:29:09.729  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 05:29:09.754  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 05:29:10.518  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 05:29:10.687  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.8]
    2017-03-17 05:29:10.688  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 05:29:10.707  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 05:29:10.741  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701
    2017-03-17 05:29:10.741  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 05:29:10.742  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 05:29:11.113  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 05:29:12.036  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 05:29:12.335  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 05:29:12.339  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 05:29:12.349  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING
    2017-03-17 05:29:12.352  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 05:29:12.392  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.8]:5701 - 296401a1-2d9a-41dc-9c20-e6ba2c1cc411 this
    }

    2017-03-17 05:29:12.470  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED
    2017-03-17 05:29:12.473  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.903 seconds (JVM running for 6.785)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4224/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-d6hrq] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42108ff50 exit status 1 <nil> <nil> true [0xc4204d43c8 0xc4204d43e0 0xc4204d43f8] [0xc4204d43c8 0xc4204d43e0 0xc4204d43f8] [0xc4204d43d8 0xc4204d43f0] [0xc35e70 0xc35e70] 0xc420b46600 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-d6hrq] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42108ff50 exit status 1 <nil> <nil> true [0xc4204d43c8 0xc4204d43e0 0xc4204d43f8] [0xc4204d43c8 0xc4204d43e0 0xc4204d43f8] [0xc4204d43d8 0xc4204d43f0] [0xc35e70 0xc35e70] 0xc420b46600 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4207cd810>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-gqlrl\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:39:08 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:39:08 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.12; broadcast_rpc_address=10.180.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gqlrl}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:39:08 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:39:09 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:39:09 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:39:09 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-gqlrl
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  06:39:08 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:39:08 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.12; broadcast_rpc_address=10.180.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-gqlrl}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:39:08 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:39:09 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:39:09 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:39:09 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4214c53c0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 06:46:03.061  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-lfzs5 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-17 06:46:03.074  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 06:46:03.151  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 06:46:03 GMT 2017]; root of context hierarchy\n2017-03-17 06:46:05.909  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 06:46:05.931  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 06:46:07.942  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 06:46:08.456  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.27]\n2017-03-17 06:46:08.456  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 06:46:08.470  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.27]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 06:46:08.501  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.27]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.27]:5701\n2017-03-17 06:46:08.502  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.27]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 06:46:08.502  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.27]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 06:46:09.498  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.27]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 06:46:12.256  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.27]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 06:46:13.028  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.27]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 06:46:13.043  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.27]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 06:46:13.066  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.27]:5701 [someGroup] [3.7.5] [10.180.2.27]:5701 is STARTING\n2017-03-17 06:46:13.071  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.27]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 06:46:13.131  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.27]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.27]:5701 - 560f2bb1-a331-4eb1-8987-2dbadfe5cee2 this\n}\n\n2017-03-17 06:46:13.230  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.27]:5701 [someGroup] [3.7.5] [10.180.2.27]:5701 is STARTED\n2017-03-17 06:46:13.243  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 11.336 seconds (JVM running for 12.211)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 06:46:03.061  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-lfzs5 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-17 06:46:03.074  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 06:46:03.151  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 06:46:03 GMT 2017]; root of context hierarchy
    2017-03-17 06:46:05.909  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 06:46:05.931  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 06:46:07.942  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 06:46:08.456  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.27]
    2017-03-17 06:46:08.456  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 06:46:08.470  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.27]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 06:46:08.501  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.27]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.27]:5701
    2017-03-17 06:46:08.502  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.27]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 06:46:08.502  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.27]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 06:46:09.498  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.27]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 06:46:12.256  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.27]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 06:46:13.028  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.27]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 06:46:13.043  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.27]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 06:46:13.066  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.27]:5701 [someGroup] [3.7.5] [10.180.2.27]:5701 is STARTING
    2017-03-17 06:46:13.071  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.27]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 06:46:13.131  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.27]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.27]:5701 - 560f2bb1-a331-4eb1-8987-2dbadfe5cee2 this
    }

    2017-03-17 06:46:13.230  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.27]:5701 [someGroup] [3.7.5] [10.180.2.27]:5701 is STARTED
    2017-03-17 06:46:13.243  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 11.336 seconds (JVM running for 12.211)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4225/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.162.68 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wk1j2] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421433290 exit status 1 <nil> <nil> true [0xc420eba610 0xc420eba630 0xc420eba648] [0xc420eba610 0xc420eba630 0xc420eba648] [0xc420eba628 0xc420eba640] [0xc35e70 0xc35e70] 0xc42103b440 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.162.68 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-wk1j2] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421433290 exit status 1 <nil> <nil> true [0xc420eba610 0xc420eba630 0xc420eba648] [0xc420eba610 0xc420eba630 0xc420eba648] [0xc420eba628 0xc420eba640] [0xc35e70 0xc35e70] 0xc42103b440 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42105d8f0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.9\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.9\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.9\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.9\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-9tv1m\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  07:40:40 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  07:40:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.9; broadcast_rpc_address=10.180.3.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9tv1m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  07:40:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  07:40:41 Global memtable on-heap threshold is enabled at 128MB\nINFO  07:40:41 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 07:40:41 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.9
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.9
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.9
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.9
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-9tv1m
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  07:40:40 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  07:40:41 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.9; broadcast_rpc_address=10.180.3.9; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.9; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-9tv1m}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  07:40:41 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  07:40:41 Global memtable on-heap threshold is enabled at 128MB
    INFO  07:40:41 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 07:40:41 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42105d480>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 07:45:39.658  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-67jtj with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-17 07:45:39.666  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 07:45:39.848  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 07:45:39 GMT 2017]; root of context hierarchy\n2017-03-17 07:45:41.565  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 07:45:41.594  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 07:45:42.244  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 07:45:42.384  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.24]\n2017-03-17 07:45:42.384  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 07:45:42.395  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.24]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 07:45:42.431  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.24]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.24]:5701\n2017-03-17 07:45:42.431  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.24]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 07:45:42.431  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.24]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 07:45:42.758  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.24]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 07:45:43.594  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.24]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 07:45:43.899  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.24]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 07:45:43.905  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.24]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 07:45:43.917  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.24]:5701 [someGroup] [3.7.5] [10.180.1.24]:5701 is STARTING\n2017-03-17 07:45:43.920  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.24]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 07:45:43.941  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.24]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.24]:5701 - 416aeb16-ff95-4ea3-bb69-3a024ba3fbef this\n}\n\n2017-03-17 07:45:44.017  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.24]:5701 [someGroup] [3.7.5] [10.180.1.24]:5701 is STARTED\n2017-03-17 07:45:44.026  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.327 seconds (JVM running for 6.228)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 07:45:39.658  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-67jtj with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-17 07:45:39.666  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 07:45:39.848  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 07:45:39 GMT 2017]; root of context hierarchy
    2017-03-17 07:45:41.565  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 07:45:41.594  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 07:45:42.244  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 07:45:42.384  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.24]
    2017-03-17 07:45:42.384  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 07:45:42.395  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.24]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 07:45:42.431  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.24]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.24]:5701
    2017-03-17 07:45:42.431  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.24]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 07:45:42.431  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.1.24]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 07:45:42.758  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.24]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 07:45:43.594  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.1.24]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 07:45:43.899  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.24]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 07:45:43.905  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.24]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 07:45:43.917  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.24]:5701 [someGroup] [3.7.5] [10.180.1.24]:5701 is STARTING
    2017-03-17 07:45:43.920  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.24]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 07:45:43.941  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.24]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.24]:5701 - 416aeb16-ff95-4ea3-bb69-3a024ba3fbef this
    }

    2017-03-17 07:45:44.017  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.24]:5701 [someGroup] [3.7.5] [10.180.1.24]:5701 is STARTED
    2017-03-17 07:45:44.026  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.327 seconds (JVM running for 6.228)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4226/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4222aec50>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 08:41:47.281  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-7nt60 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 08:41:47.306  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 08:41:47.391  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 08:41:47 GMT 2017]; root of context hierarchy\n2017-03-17 08:41:49.306  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 08:41:49.327  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 08:41:49.974  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 08:41:50.115  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.12]\n2017-03-17 08:41:50.116  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 08:41:50.129  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 08:41:50.166  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.12]:5701\n2017-03-17 08:41:50.166  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 08:41:50.166  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 08:41:50.564  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.12]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 08:41:51.469  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 08:41:51.767  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 08:41:51.775  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 08:41:51.788  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.12]:5701 [someGroup] [3.7.5] [10.180.3.12]:5701 is STARTING\n2017-03-17 08:41:51.789  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 08:41:51.854  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.12]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.12]:5701 - 998e1658-176b-4b63-880e-758307d6e905 this\n}\n\n2017-03-17 08:41:51.936  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.12]:5701 [someGroup] [3.7.5] [10.180.3.12]:5701 is STARTED\n2017-03-17 08:41:51.949  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.778 seconds (JVM running for 6.766)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 08:41:47.281  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-7nt60 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 08:41:47.306  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 08:41:47.391  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 08:41:47 GMT 2017]; root of context hierarchy
    2017-03-17 08:41:49.306  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 08:41:49.327  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 08:41:49.974  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 08:41:50.115  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.12]
    2017-03-17 08:41:50.116  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 08:41:50.129  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.12]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 08:41:50.166  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.12]:5701
    2017-03-17 08:41:50.166  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 08:41:50.166  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.12]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 08:41:50.564  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.12]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 08:41:51.469  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.12]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 08:41:51.767  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.12]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 08:41:51.775  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.12]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 08:41:51.788  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.12]:5701 [someGroup] [3.7.5] [10.180.3.12]:5701 is STARTING
    2017-03-17 08:41:51.789  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.12]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 08:41:51.854  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.12]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.12]:5701 - 998e1658-176b-4b63-880e-758307d6e905 this
    }

    2017-03-17 08:41:51.936  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.12]:5701 [someGroup] [3.7.5] [10.180.3.12]:5701 is STARTED
    2017-03-17 08:41:51.949  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.778 seconds (JVM running for 6.766)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4212eac50>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-b35cw\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  08:38:31 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  08:38:32 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b35cw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  08:38:32 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  08:38:32 Global memtable on-heap threshold is enabled at 128MB\nINFO  08:38:32 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 08:38:32 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-b35cw
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  08:38:31 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  08:38:32 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b35cw}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  08:38:32 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  08:38:32 Global memtable on-heap threshold is enabled at 128MB
    INFO  08:38:32 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 08:38:32 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-kj8nq] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e11f50 exit status 1 <nil> <nil> true [0xc4202c0b68 0xc4202c0b88 0xc4202c0ba0] [0xc4202c0b68 0xc4202c0b88 0xc4202c0ba0] [0xc4202c0b80 0xc4202c0b98] [0xc35e70 0xc35e70] 0xc420d87320 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-kj8nq] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420e11f50 exit status 1 <nil> <nil> true [0xc4202c0b68 0xc4202c0b88 0xc4202c0ba0] [0xc4202c0b68 0xc4202c0b88 0xc4202c0ba0] [0xc4202c0b80 0xc4202c0b98] [0xc35e70 0xc35e70] 0xc420d87320 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4227/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jwrxc] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4217a3ce0 exit status 1 <nil> <nil> true [0xc420204e30 0xc420204e60 0xc420204e78] [0xc420204e30 0xc420204e60 0xc420204e78] [0xc420204e50 0xc420204e70] [0xc35e70 0xc35e70] 0xc42175c960 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-jwrxc] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4217a3ce0 exit status 1 <nil> <nil> true [0xc420204e30 0xc420204e60 0xc420204e78] [0xc420204e30 0xc420204e60 0xc420204e78] [0xc420204e50 0xc420204e70] [0xc35e70 0xc35e70] 0xc42175c960 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420be0960>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 09:31:20.356  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-3n619 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-17 09:31:20.364  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 09:31:20.593  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 09:31:20 GMT 2017]; root of context hierarchy\n2017-03-17 09:31:22.363  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 09:31:22.381  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 09:31:23.075  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 09:31:23.281  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.9]\n2017-03-17 09:31:23.281  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 09:31:23.293  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 09:31:23.327  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.9]:5701\n2017-03-17 09:31:23.327  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 09:31:23.327  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 09:31:23.691  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 09:31:24.580  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 09:31:24.856  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 09:31:24.866  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 09:31:24.879  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTING\n2017-03-17 09:31:24.880  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 09:31:24.911  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.9]:5701 - f4760440-06d4-4388-9369-cd99a9350634 this\n}\n\n2017-03-17 09:31:24.979  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTED\n2017-03-17 09:31:24.986  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.621 seconds (JVM running for 6.472)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 09:31:20.356  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-3n619 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-17 09:31:20.364  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 09:31:20.593  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 09:31:20 GMT 2017]; root of context hierarchy
    2017-03-17 09:31:22.363  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 09:31:22.381  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 09:31:23.075  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 09:31:23.281  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.9]
    2017-03-17 09:31:23.281  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 09:31:23.293  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 09:31:23.327  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.9]:5701
    2017-03-17 09:31:23.327  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 09:31:23.327  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 09:31:23.691  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 09:31:24.580  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 09:31:24.856  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 09:31:24.866  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 09:31:24.879  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTING
    2017-03-17 09:31:24.880  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 09:31:24.911  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.9]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.9]:5701 - f4760440-06d4-4388-9369-cd99a9350634 this
    }

    2017-03-17 09:31:24.979  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.9]:5701 [someGroup] [3.7.5] [10.180.1.9]:5701 is STARTED
    2017-03-17 09:31:24.986  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.621 seconds (JVM running for 6.472)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421a9a7e0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-5bgx6\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  09:48:38 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  09:48:38 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5bgx6}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  09:48:38 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  09:48:38 Global memtable on-heap threshold is enabled at 128MB\nINFO  09:48:38 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 09:48:38 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-5bgx6
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  09:48:38 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  09:48:38 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.11; broadcast_rpc_address=10.180.1.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-5bgx6}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  09:48:38 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  09:48:38 Global memtable on-heap threshold is enabled at 128MB
    INFO  09:48:38 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 09:48:38 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4228/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc4207ace30>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 10:57:33.437  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-30bj8 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 10:57:33.453  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 10:57:33.589  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 10:57:33 GMT 2017]; root of context hierarchy\n2017-03-17 10:57:35.445  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 10:57:35.465  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 10:57:36.094  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 10:57:36.234  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]\n2017-03-17 10:57:36.234  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 10:57:36.247  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 10:57:36.281  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701\n2017-03-17 10:57:36.281  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 10:57:36.281  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 10:57:36.598  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 10:57:37.448  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 10:57:37.776  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 10:57:37.777  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 10:57:37.786  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING\n2017-03-17 10:57:37.792  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 10:57:37.844  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.16]:5701 - bd44904c-66b0-4911-837f-c1744fe30886 this\n}\n\n2017-03-17 10:57:37.913  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED\n2017-03-17 10:57:37.918  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.499 seconds (JVM running for 6.379)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 10:57:33.437  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-30bj8 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 10:57:33.453  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 10:57:33.589  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 10:57:33 GMT 2017]; root of context hierarchy
    2017-03-17 10:57:35.445  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 10:57:35.465  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 10:57:36.094  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 10:57:36.234  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.16]
    2017-03-17 10:57:36.234  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 10:57:36.247  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 10:57:36.281  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.16]:5701
    2017-03-17 10:57:36.281  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 10:57:36.281  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 10:57:36.598  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 10:57:37.448  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 10:57:37.776  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 10:57:37.777  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 10:57:37.786  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTING
    2017-03-17 10:57:37.792  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 10:57:37.844  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.16]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.16]:5701 - bd44904c-66b0-4911-837f-c1744fe30886 this
    }

    2017-03-17 10:57:37.913  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.16]:5701 [someGroup] [3.7.5] [10.180.1.16]:5701 is STARTED
    2017-03-17 10:57:37.918  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.499 seconds (JVM running for 6.379)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-x8n3v] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421ba1650 exit status 1 <nil> <nil> true [0xc4200363d0 0xc420036418 0xc420036448] [0xc4200363d0 0xc420036418 0xc420036448] [0xc420036400 0xc420036430] [0xc35e70 0xc35e70] 0xc421628d20 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-x8n3v] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421ba1650 exit status 1 <nil> <nil> true [0xc4200363d0 0xc420036418 0xc420036448] [0xc4200363d0 0xc420036418 0xc420036448] [0xc420036400 0xc420036430] [0xc35e70 0xc35e70] 0xc421628d20 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420cc4610>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-43jdl\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  10:47:25 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  10:47:25 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-43jdl}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  10:47:25 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  10:47:25 Global memtable on-heap threshold is enabled at 128MB\nINFO  10:47:25 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 10:47:25 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-43jdl
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  10:47:25 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  10:47:25 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-43jdl}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  10:47:25 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  10:47:25 Global memtable on-heap threshold is enabled at 128MB
    INFO  10:47:25 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 10:47:25 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4229/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b0759] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420c985d0 exit status 1 <nil> <nil> true [0xc4204886a0 0xc4204886c0 0xc4204886e8] [0xc4204886a0 0xc4204886c0 0xc4204886e8] [0xc4204886b8 0xc4204886d8] [0xc35e70 0xc35e70] 0xc42122ae40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-b0759] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420c985d0 exit status 1 <nil> <nil> true [0xc4204886a0 0xc4204886c0 0xc4204886e8] [0xc4204886a0 0xc4204886c0 0xc4204886e8] [0xc4204886b8 0xc4204886d8] [0xc35e70 0xc35e70] 0xc42122ae40 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4210a8cb0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.11\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.11\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.11\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-b9bb1\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  11:44:33 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  11:44:33 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b9bb1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  11:44:33 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  11:44:33 Global memtable on-heap threshold is enabled at 128MB\nINFO  11:44:33 Global memtable off-heap threshold is enabled at 128MB\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\nERROR 11:44:34 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.11
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.11
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.11
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.11
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-b9bb1
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  11:44:33 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  11:44:33 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.11; broadcast_rpc_address=10.180.2.11; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.11; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-b9bb1}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  11:44:33 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  11:44:33 Global memtable on-heap threshold is enabled at 128MB
    INFO  11:44:33 Global memtable off-heap threshold is enabled at 128MB
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    ERROR 11:44:34 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420a22060>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 11:53:50.423  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9bsbr with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 11:53:50.451  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 11:53:50.580  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 11:53:50 GMT 2017]; root of context hierarchy\n2017-03-17 11:53:52.203  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 11:53:52.221  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 11:53:52.835  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 11:53:52.976  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.13]\n2017-03-17 11:53:52.976  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 11:53:52.987  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 11:53:53.025  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.13]:5701\n2017-03-17 11:53:53.025  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 11:53:53.025  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 11:53:53.370  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 11:53:54.224  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 11:53:54.549  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 11:53:54.558  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 11:53:54.566  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTING\n2017-03-17 11:53:54.571  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 11:53:54.631  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.13]:5701 - e6d6ab40-3f1e-43bd-b8a6-420965456ef4 this\n}\n\n2017-03-17 11:53:54.756  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTED\n2017-03-17 11:53:54.763  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.472 seconds (JVM running for 6.331)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 11:53:50.423  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9bsbr with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 11:53:50.451  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 11:53:50.580  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 11:53:50 GMT 2017]; root of context hierarchy
    2017-03-17 11:53:52.203  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 11:53:52.221  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 11:53:52.835  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 11:53:52.976  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.13]
    2017-03-17 11:53:52.976  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 11:53:52.987  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 11:53:53.025  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.13]:5701
    2017-03-17 11:53:53.025  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 11:53:53.025  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.1.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 11:53:53.370  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 11:53:54.224  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.1.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 11:53:54.549  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 11:53:54.558  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 11:53:54.566  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTING
    2017-03-17 11:53:54.571  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 11:53:54.631  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.13]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.13]:5701 - e6d6ab40-3f1e-43bd-b8a6-420965456ef4 this
    }

    2017-03-17 11:53:54.756  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.13]:5701 [someGroup] [3.7.5] [10.180.1.13]:5701 is STARTED
    2017-03-17 11:53:54.763  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.472 seconds (JVM running for 6.331)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4230/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420b24d70>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-1dhd4\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  12:52:03 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  12:52:04 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.10; broadcast_rpc_address=10.180.3.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1dhd4}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  12:52:04 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  12:52:04 Global memtable on-heap threshold is enabled at 128MB\nINFO  12:52:04 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 12:52:04 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-1dhd4
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  12:52:03 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  12:52:04 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.10; broadcast_rpc_address=10.180.3.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-1dhd4}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  12:52:04 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  12:52:04 Global memtable on-heap threshold is enabled at 128MB
    INFO  12:52:04 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 12:52:04 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9486z] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421214d80 exit status 1 <nil> <nil> true [0xc42019a4f8 0xc42019a530 0xc42019a558] [0xc42019a4f8 0xc42019a530 0xc42019a558] [0xc42019a510 0xc42019a550] [0xc35e70 0xc35e70] 0xc421508f00 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9486z] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421214d80 exit status 1 <nil> <nil> true [0xc42019a4f8 0xc42019a530 0xc42019a558] [0xc42019a4f8 0xc42019a530 0xc42019a558] [0xc42019a510 0xc42019a550] [0xc35e70 0xc35e70] 0xc421508f00 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421169950>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 13:01:52.876  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-pxrmk with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 13:01:52.884  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 13:01:53.055  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 13:01:53 GMT 2017]; root of context hierarchy\n2017-03-17 13:01:55.125  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 13:01:55.149  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 13:01:55.797  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 13:01:55.940  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.16]\n2017-03-17 13:01:55.941  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 13:01:55.954  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 13:01:55.989  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.16]:5701\n2017-03-17 13:01:55.990  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 13:01:55.990  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 13:01:56.372  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.16]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 13:01:57.255  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 13:01:57.563  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 13:01:57.565  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 13:01:57.578  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTING\n2017-03-17 13:01:57.580  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 13:01:57.612  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.16]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.16]:5701 - 81c71ba2-6aa0-4569-ad92-34c0792583ab this\n}\n\n2017-03-17 13:01:57.687  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTED\n2017-03-17 13:01:57.695  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.769 seconds (JVM running for 6.703)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 13:01:52.876  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-pxrmk with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 13:01:52.884  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 13:01:53.055  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 13:01:53 GMT 2017]; root of context hierarchy
    2017-03-17 13:01:55.125  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 13:01:55.149  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 13:01:55.797  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 13:01:55.940  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.16]
    2017-03-17 13:01:55.941  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 13:01:55.954  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.16]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 13:01:55.989  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.16]:5701
    2017-03-17 13:01:55.990  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 13:01:55.990  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.16]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 13:01:56.372  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.16]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 13:01:57.255  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.16]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 13:01:57.563  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 13:01:57.565  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.16]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 13:01:57.578  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTING
    2017-03-17 13:01:57.580  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.16]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 13:01:57.612  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.16]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.16]:5701 - 81c71ba2-6aa0-4569-ad92-34c0792583ab this
    }

    2017-03-17 13:01:57.687  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.16]:5701 [someGroup] [3.7.5] [10.180.3.16]:5701 is STARTED
    2017-03-17 13:01:57.695  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.769 seconds (JVM running for 6.703)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4231/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421b899a0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.16\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.16\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.16\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-20ttn\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  14:05:13 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  14:05:13 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-20ttn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  14:05:13 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  14:05:14 Global memtable on-heap threshold is enabled at 128MB\nINFO  14:05:14 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 14:05:14 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.16
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.16
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.16
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.16
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-20ttn
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  14:05:13 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  14:05:13 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.16; broadcast_rpc_address=10.180.3.16; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.16; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-20ttn}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  14:05:13 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  14:05:14 Global memtable on-heap threshold is enabled at 128MB
    INFO  14:05:14 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 14:05:14 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-j9ts3] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420bbd710 exit status 1 <nil> <nil> true [0xc420036e80 0xc420036ea0 0xc420036ec8] [0xc420036e80 0xc420036ea0 0xc420036ec8] [0xc420036e98 0xc420036ec0] [0xc35e70 0xc35e70] 0xc420d8c480 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.153.28 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-j9ts3] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420bbd710 exit status 1 <nil> <nil> true [0xc420036e80 0xc420036ea0 0xc420036ec8] [0xc420036e80 0xc420036ea0 0xc420036ec8] [0xc420036e98 0xc420036ec0] [0xc35e70 0xc35e70] 0xc420d8c480 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421bae550>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 13:44:55.460  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-cbbxh with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-17 13:44:55.467  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 13:44:55.553  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 13:44:55 GMT 2017]; root of context hierarchy\n2017-03-17 13:44:57.390  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 13:44:57.412  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 13:44:58.055  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 13:44:58.170  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.11]\n2017-03-17 13:44:58.171  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 13:44:58.184  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 13:44:58.215  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.11]:5701\n2017-03-17 13:44:58.215  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 13:44:58.216  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 13:44:58.586  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.11]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 13:44:59.456  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 13:44:59.778  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 13:44:59.781  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 13:44:59.795  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTING\n2017-03-17 13:44:59.800  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 13:44:59.831  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.11]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.11]:5701 - 4d8a8fa5-1e26-4122-bc78-b81dcfce451b this\n}\n\n2017-03-17 13:44:59.904  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTED\n2017-03-17 13:44:59.911  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.449 seconds (JVM running for 6.365)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 13:44:55.460  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-cbbxh with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-17 13:44:55.467  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 13:44:55.553  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 13:44:55 GMT 2017]; root of context hierarchy
    2017-03-17 13:44:57.390  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 13:44:57.412  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 13:44:58.055  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 13:44:58.170  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.11]
    2017-03-17 13:44:58.171  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 13:44:58.184  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.11]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 13:44:58.215  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.11]:5701
    2017-03-17 13:44:58.215  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 13:44:58.216  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.11]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 13:44:58.586  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.11]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 13:44:59.456  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.11]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 13:44:59.778  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 13:44:59.781  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.11]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 13:44:59.795  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTING
    2017-03-17 13:44:59.800  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.11]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 13:44:59.831  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.11]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.11]:5701 - 4d8a8fa5-1e26-4122-bc78-b81dcfce451b this
    }

    2017-03-17 13:44:59.904  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.11]:5701 [someGroup] [3.7.5] [10.180.3.11]:5701 is STARTED
    2017-03-17 13:44:59.911  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.449 seconds (JVM running for 6.365)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4232/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420faaff0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 14:44:41.587  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-p2w61 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 14:44:41.594  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 14:44:41.754  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 14:44:41 GMT 2017]; root of context hierarchy\n2017-03-17 14:44:43.626  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 14:44:43.653  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 14:44:44.274  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 14:44:44.398  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.8]\n2017-03-17 14:44:44.399  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 14:44:44.411  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 14:44:44.456  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.8]:5701\n2017-03-17 14:44:44.456  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 14:44:44.456  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 14:44:44.821  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 14:44:45.717  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 14:44:46.000  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 14:44:46.009  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 14:44:46.044  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTING\n2017-03-17 14:44:46.048  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 14:44:46.072  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.8]:5701 - 797249c3-4318-4b3d-98bd-12314442a3e0 this\n}\n\n2017-03-17 14:44:46.136  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTED\n2017-03-17 14:44:46.139  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.595 seconds (JVM running for 6.571)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 14:44:41.587  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-p2w61 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 14:44:41.594  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 14:44:41.754  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 14:44:41 GMT 2017]; root of context hierarchy
    2017-03-17 14:44:43.626  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 14:44:43.653  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 14:44:44.274  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 14:44:44.398  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.8]
    2017-03-17 14:44:44.399  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 14:44:44.411  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 14:44:44.456  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.8]:5701
    2017-03-17 14:44:44.456  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 14:44:44.456  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 14:44:44.821  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 14:44:45.717  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 14:44:46.000  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 14:44:46.009  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 14:44:46.044  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTING
    2017-03-17 14:44:46.048  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 14:44:46.072  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.8]:5701 - 797249c3-4318-4b3d-98bd-12314442a3e0 this
    }

    2017-03-17 14:44:46.136  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.8]:5701 [someGroup] [3.7.5] [10.180.2.8]:5701 is STARTED
    2017-03-17 14:44:46.139  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.595 seconds (JVM running for 6.571)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.162.68 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nc98z] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4210788d0 exit status 1 <nil> <nil> true [0xc4205386f0 0xc420538710 0xc420538730] [0xc4205386f0 0xc420538710 0xc420538730] [0xc420538708 0xc420538728] [0xc35e70 0xc35e70] 0xc421091f80 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.162.68 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-nc98z] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4210788d0 exit status 1 <nil> <nil> true [0xc4205386f0 0xc420538710 0xc420538730] [0xc4205386f0 0xc420538710 0xc420538730] [0xc420538708 0xc420538728] [0xc35e70 0xc35e70] 0xc421091f80 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421e5e450>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.14\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.14\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.14\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2m9qz\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  15:07:48 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  15:07:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2m9qz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  15:07:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  15:07:49 Global memtable on-heap threshold is enabled at 128MB\nINFO  15:07:49 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 15:07:49 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.14
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.14
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.14
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.14
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-2m9qz
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  15:07:48 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  15:07:49 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.14; broadcast_rpc_address=10.180.3.14; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.14; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2m9qz}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  15:07:49 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  15:07:49 Global memtable on-heap threshold is enabled at 128MB
    INFO  15:07:49 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 15:07:49 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4233/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421222240>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 15:47:58.380  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-k1f3j with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 15:47:58.399  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 15:47:58.482  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 15:47:58 GMT 2017]; root of context hierarchy\n2017-03-17 15:48:00.253  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 15:48:00.276  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 15:48:00.957  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 15:48:01.092  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.7]\n2017-03-17 15:48:01.092  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 15:48:01.105  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 15:48:01.149  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.7]:5701\n2017-03-17 15:48:01.150  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 15:48:01.150  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 15:48:01.495  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.7]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 15:48:02.415  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 15:48:02.720  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 15:48:02.735  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 15:48:02.744  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTING\n2017-03-17 15:48:02.745  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 15:48:02.793  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.7]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.7]:5701 - 0417fee2-024c-4fbd-a988-fec7772a4cd5 this\n}\n\n2017-03-17 15:48:02.844  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTED\n2017-03-17 15:48:02.852  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.446 seconds (JVM running for 6.349)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 15:47:58.380  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-k1f3j with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 15:47:58.399  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 15:47:58.482  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 15:47:58 GMT 2017]; root of context hierarchy
    2017-03-17 15:48:00.253  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 15:48:00.276  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 15:48:00.957  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 15:48:01.092  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.7]
    2017-03-17 15:48:01.092  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 15:48:01.105  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 15:48:01.149  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.7]:5701
    2017-03-17 15:48:01.150  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 15:48:01.150  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 15:48:01.495  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.7]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 15:48:02.415  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 15:48:02.720  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 15:48:02.735  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 15:48:02.744  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTING
    2017-03-17 15:48:02.745  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 15:48:02.793  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.7]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.7]:5701 - 0417fee2-024c-4fbd-a988-fec7772a4cd5 this
    }

    2017-03-17 15:48:02.844  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.7]:5701 [someGroup] [3.7.5] [10.180.3.7]:5701 is STARTED
    2017-03-17 15:48:02.852  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.446 seconds (JVM running for 6.349)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421aeaa10>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.8\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.8\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.8\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.8\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-qkwr3\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  16:02:57 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  16:02:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.8; broadcast_rpc_address=10.180.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-qkwr3}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  16:02:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  16:02:58 Global memtable on-heap threshold is enabled at 128MB\nINFO  16:02:58 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 16:02:58 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.8
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.8
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.8
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.8
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-qkwr3
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  16:02:57 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  16:02:58 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.8; broadcast_rpc_address=10.180.3.8; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.8; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-qkwr3}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  16:02:58 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  16:02:58 Global memtable on-heap threshold is enabled at 128MB
    INFO  16:02:58 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 16:02:58 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-hmqw0] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4218dda70 exit status 1 <nil> <nil> true [0xc420b960d8 0xc420b96120 0xc420b96148] [0xc420b960d8 0xc420b96120 0xc420b96148] [0xc420b96108 0xc420b96138] [0xc35e70 0xc35e70] 0xc420e1c660 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-hmqw0] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4218dda70 exit status 1 <nil> <nil> true [0xc420b960d8 0xc420b96120 0xc420b96148] [0xc420b960d8 0xc420b96120 0xc420b96148] [0xc420b96108 0xc420b96138] [0xc35e70 0xc35e70] 0xc420e1c660 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4234/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pmxhv] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4214b6b70 exit status 1 <nil> <nil> true [0xc420038678 0xc420038690 0xc4200386a8] [0xc420038678 0xc420038690 0xc4200386a8] [0xc420038688 0xc4200386a0] [0xc35e70 0xc35e70] 0xc4210895c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-pmxhv] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4214b6b70 exit status 1 <nil> <nil> true [0xc420038678 0xc420038690 0xc4200386a8] [0xc420038678 0xc420038690 0xc4200386a8] [0xc420038688 0xc4200386a0] [0xc35e70 0xc35e70] 0xc4210895c0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421217f60>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-jtx2q\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  17:10:54 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  17:10:54 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.12; broadcast_rpc_address=10.180.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-jtx2q}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  17:10:54 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  17:10:54 Global memtable on-heap threshold is enabled at 128MB\nINFO  17:10:54 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 17:10:54 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-jtx2q
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  17:10:54 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  17:10:54 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.12; broadcast_rpc_address=10.180.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-jtx2q}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  17:10:54 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  17:10:54 Global memtable on-heap threshold is enabled at 128MB
    INFO  17:10:54 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 17:10:54 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42001d990>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 17:13:23.720  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-6k8c3 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 17:13:23.727  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 17:13:23.790  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 17:13:23 GMT 2017]; root of context hierarchy\n2017-03-17 17:13:25.201  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 17:13:25.222  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 17:13:25.841  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 17:13:25.954  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.25]\n2017-03-17 17:13:25.955  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 17:13:25.966  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.25]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 17:13:25.998  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.25]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.25]:5701\n2017-03-17 17:13:25.998  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.25]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 17:13:25.998  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.25]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 17:13:26.327  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.25]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 17:13:27.086  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.25]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 17:13:27.357  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.25]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 17:13:27.367  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.25]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 17:13:27.386  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.25]:5701 [someGroup] [3.7.5] [10.180.2.25]:5701 is STARTING\n2017-03-17 17:13:27.395  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.25]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 17:13:27.442  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.25]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.25]:5701 - d2360c1e-2dec-44d7-b899-2f25d44a9413 this\n}\n\n2017-03-17 17:13:27.504  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.25]:5701 [someGroup] [3.7.5] [10.180.2.25]:5701 is STARTED\n2017-03-17 17:13:27.508  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.723 seconds (JVM running for 5.572)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 17:13:23.720  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-6k8c3 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 17:13:23.727  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 17:13:23.790  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 17:13:23 GMT 2017]; root of context hierarchy
    2017-03-17 17:13:25.201  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 17:13:25.222  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 17:13:25.841  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 17:13:25.954  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.25]
    2017-03-17 17:13:25.955  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 17:13:25.966  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.25]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 17:13:25.998  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.25]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.25]:5701
    2017-03-17 17:13:25.998  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.25]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 17:13:25.998  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.25]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 17:13:26.327  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.25]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 17:13:27.086  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.25]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 17:13:27.357  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.25]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 17:13:27.367  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.25]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 17:13:27.386  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.25]:5701 [someGroup] [3.7.5] [10.180.2.25]:5701 is STARTING
    2017-03-17 17:13:27.395  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.25]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 17:13:27.442  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.25]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.25]:5701 - d2360c1e-2dec-44d7-b899-2f25d44a9413 this
    }

    2017-03-17 17:13:27.504  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.25]:5701 [someGroup] [3.7.5] [10.180.2.25]:5701 is STARTED
    2017-03-17 17:13:27.508  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 4.723 seconds (JVM running for 5.572)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4235/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vz2xh] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4214d9b60 exit status 1 <nil> <nil> true [0xc42034a8a0 0xc42034a8f0 0xc42034a918] [0xc42034a8a0 0xc42034a8f0 0xc42034a918] [0xc42034a8c8 0xc42034a908] [0xc35e70 0xc35e70] 0xc421023b60 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.194.244 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vz2xh] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4214d9b60 exit status 1 <nil> <nil> true [0xc42034a8a0 0xc42034a8f0 0xc42034a918] [0xc42034a8a0 0xc42034a8f0 0xc42034a918] [0xc42034a8c8 0xc42034a908] [0xc35e70 0xc35e70] 0xc421023b60 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42201d350>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.26\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.26\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.26\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.26\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-q11sp\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  18:22:21 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  18:22:22 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.26; broadcast_rpc_address=10.180.2.26; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.26; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q11sp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  18:22:22 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  18:22:22 Global memtable on-heap threshold is enabled at 128MB\nINFO  18:22:22 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 18:22:22 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.26
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.26
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.26
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.26
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-q11sp
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  18:22:21 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  18:22:22 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.26; broadcast_rpc_address=10.180.2.26; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.26; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-q11sp}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  18:22:22 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  18:22:22 Global memtable on-heap threshold is enabled at 128MB
    INFO  18:22:22 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 18:22:22 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420f844d0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 17:55:35.777  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9tv38 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 17:55:35.807  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 17:55:35.946  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 17:55:35 GMT 2017]; root of context hierarchy\n2017-03-17 17:55:37.739  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 17:55:37.766  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 17:55:38.425  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 17:55:38.559  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.13]\n2017-03-17 17:55:38.560  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 17:55:38.573  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 17:55:38.608  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.13]:5701\n2017-03-17 17:55:38.608  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 17:55:38.608  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 17:55:38.984  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.13]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 17:55:39.866  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 17:55:40.192  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 17:55:40.201  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 17:55:40.210  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTING\n2017-03-17 17:55:40.215  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 17:55:40.261  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.13]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.13]:5701 - d2681260-a752-44b7-a0a7-1126d78ecd52 this\n}\n\n2017-03-17 17:55:40.345  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTED\n2017-03-17 17:55:40.350  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.543 seconds (JVM running for 6.471)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 17:55:35.777  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9tv38 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 17:55:35.807  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 17:55:35.946  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 17:55:35 GMT 2017]; root of context hierarchy
    2017-03-17 17:55:37.739  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 17:55:37.766  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 17:55:38.425  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 17:55:38.559  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.13]
    2017-03-17 17:55:38.560  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 17:55:38.573  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.13]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 17:55:38.608  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.13]:5701
    2017-03-17 17:55:38.608  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 17:55:38.608  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.13]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 17:55:38.984  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.13]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 17:55:39.866  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.13]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 17:55:40.192  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 17:55:40.201  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.13]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 17:55:40.210  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTING
    2017-03-17 17:55:40.215  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.13]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 17:55:40.261  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.13]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.13]:5701 - d2681260-a752-44b7-a0a7-1126d78ecd52 this
    }

    2017-03-17 17:55:40.345  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.13]:5701 [someGroup] [3.7.5] [10.180.2.13]:5701 is STARTED
    2017-03-17 17:55:40.350  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.543 seconds (JVM running for 6.471)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4236/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421846310>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-2q3b3\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  19:15:51 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  19:15:51 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.10; broadcast_rpc_address=10.180.3.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2q3b3}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  19:15:51 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  19:15:51 Global memtable on-heap threshold is enabled at 128MB\nINFO  19:15:51 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 19:15:51 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-2q3b3
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  19:15:51 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  19:15:51 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.10; broadcast_rpc_address=10.180.3.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-2q3b3}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  19:15:51 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  19:15:51 Global memtable on-heap threshold is enabled at 128MB
    INFO  19:15:51 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 19:15:51 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0c416] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42179fa40 exit status 1 <nil> <nil> true [0xc420496970 0xc420496990 0xc4204969b0] [0xc420496970 0xc420496990 0xc4204969b0] [0xc420496988 0xc4204969a8] [0xc36680 0xc36680] 0xc42103c120 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.244.187 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-0c416] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42179fa40 exit status 1 <nil> <nil> true [0xc420496970 0xc420496990 0xc4204969b0] [0xc420496970 0xc420496990 0xc4204969b0] [0xc420496988 0xc4204969a8] [0xc36680 0xc36680] 0xc42103c120 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420d74410>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 18:58:22.944  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-r09hn with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-17 18:58:23.017  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 18:58:23.133  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 18:58:23 GMT 2017]; root of context hierarchy\n2017-03-17 18:58:24.905  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 18:58:24.923  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 18:58:25.616  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 18:58:25.729  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.7]\n2017-03-17 18:58:25.730  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 18:58:25.742  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 18:58:25.772  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.7]:5701\n2017-03-17 18:58:25.772  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 18:58:25.773  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 18:58:26.082  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.7]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 18:58:26.899  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 18:58:27.170  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 18:58:27.172  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 18:58:27.197  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.7]:5701 [someGroup] [3.7.5] [10.180.0.7]:5701 is STARTING\n2017-03-17 18:58:27.201  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 18:58:27.266  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.7]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.0.7]:5701 - 64403ec9-a306-427b-b0fb-bc208202b36f this\n}\n\n2017-03-17 18:58:27.357  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.7]:5701 [someGroup] [3.7.5] [10.180.0.7]:5701 is STARTED\n2017-03-17 18:58:27.367  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.485 seconds (JVM running for 6.381)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 18:58:22.944  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-r09hn with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-17 18:58:23.017  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 18:58:23.133  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 18:58:23 GMT 2017]; root of context hierarchy
    2017-03-17 18:58:24.905  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 18:58:24.923  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 18:58:25.616  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 18:58:25.729  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.7]
    2017-03-17 18:58:25.730  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 18:58:25.742  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.7]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 18:58:25.772  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.7]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.7]:5701
    2017-03-17 18:58:25.772  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.7]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 18:58:25.773  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.0.7]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 18:58:26.082  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.7]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 18:58:26.899  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.0.7]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 18:58:27.170  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.7]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 18:58:27.172  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.7]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 18:58:27.197  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.7]:5701 [someGroup] [3.7.5] [10.180.0.7]:5701 is STARTING
    2017-03-17 18:58:27.201  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.7]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 18:58:27.266  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.7]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.0.7]:5701 - 64403ec9-a306-427b-b0fb-bc208202b36f this
    }

    2017-03-17 18:58:27.357  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.7]:5701 [someGroup] [3.7.5] [10.180.0.7]:5701 is STARTED
    2017-03-17 18:58:27.367  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.485 seconds (JVM running for 6.381)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4237/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc42084a260>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 20:26:01.759  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-s2djq with PID 7 (/bootstrapper.jar started by root in /)\n2017-03-17 20:26:01.783  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 20:26:01.870  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 20:26:01 GMT 2017]; root of context hierarchy\n2017-03-17 20:26:03.626  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 20:26:03.649  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 20:26:04.301  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 20:26:04.533  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.19]\n2017-03-17 20:26:04.534  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 20:26:04.549  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 20:26:04.589  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.19]:5701\n2017-03-17 20:26:04.589  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 20:26:04.589  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 20:26:05.002  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.19]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 20:26:05.862  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 20:26:06.209  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 20:26:06.223  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 20:26:06.277  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.19]:5701 [someGroup] [3.7.5] [10.180.2.19]:5701 is STARTING\n2017-03-17 20:26:06.281  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 20:26:06.315  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.19]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.19]:5701 - 88a65a1c-6b13-4bd3-8a67-ccc8624f3c51 this\n}\n\n2017-03-17 20:26:06.402  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.19]:5701 [someGroup] [3.7.5] [10.180.2.19]:5701 is STARTED\n2017-03-17 20:26:06.408  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.64 seconds (JVM running for 6.56)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 20:26:01.759  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-s2djq with PID 7 (/bootstrapper.jar started by root in /)
    2017-03-17 20:26:01.783  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 20:26:01.870  INFO 7 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 20:26:01 GMT 2017]; root of context hierarchy
    2017-03-17 20:26:03.626  INFO 7 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 20:26:03.649  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 20:26:04.301  INFO 7 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 20:26:04.533  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.19]
    2017-03-17 20:26:04.534  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 20:26:04.549  INFO 7 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 20:26:04.589  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.19]:5701
    2017-03-17 20:26:04.589  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 20:26:04.589  INFO 7 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 20:26:05.002  INFO 7 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.19]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 20:26:05.862  INFO 7 --- [           main] com.hazelcast.instance.Node              : [10.180.2.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 20:26:06.209  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 20:26:06.223  INFO 7 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 20:26:06.277  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.19]:5701 [someGroup] [3.7.5] [10.180.2.19]:5701 is STARTING
    2017-03-17 20:26:06.281  INFO 7 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 20:26:06.315  INFO 7 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.19]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.19]:5701 - 88a65a1c-6b13-4bd3-8a67-ccc8624f3c51 this
    }

    2017-03-17 20:26:06.402  INFO 7 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.19]:5701 [someGroup] [3.7.5] [10.180.2.19]:5701 is STARTED
    2017-03-17 20:26:06.408  INFO 7 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.64 seconds (JVM running for 6.56)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420c7f650>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.7\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.7\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.7\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-d1pvh\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  20:11:02 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  20:11:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-d1pvh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  20:11:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  20:11:03 Global memtable on-heap threshold is enabled at 128MB\nINFO  20:11:03 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 20:11:03 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.7
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.7
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.7
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.7
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-d1pvh
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  20:11:02 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  20:11:03 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.7; broadcast_rpc_address=10.180.3.7; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.7; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-d1pvh}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  20:11:03 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  20:11:03 Global memtable on-heap threshold is enabled at 128MB
    INFO  20:11:03 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 20:11:03 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9k5l4] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f2c930 exit status 1 <nil> <nil> true [0xc420296898 0xc4202968d8 0xc420296910] [0xc420296898 0xc4202968d8 0xc420296910] [0xc4202968c8 0xc420296900] [0xc36d60 0xc36d60] 0xc420a61080 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9k5l4] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f2c930 exit status 1 <nil> <nil> true [0xc420296898 0xc4202968d8 0xc420296910] [0xc420296898 0xc4202968d8 0xc420296910] [0xc4202968c8 0xc420296900] [0xc36d60 0xc36d60] 0xc420a61080 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4238/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.37.25 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9ts1w] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4210ae420 exit status 1 <nil> <nil> true [0xc42046e778 0xc42046e790 0xc42046e7a8] [0xc42046e778 0xc42046e790 0xc42046e7a8] [0xc42046e788 0xc42046e7a0] [0xc36d60 0xc36d60] 0xc420c1a3c0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.198.37.25 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-9ts1w] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4210ae420 exit status 1 <nil> <nil> true [0xc42046e778 0xc42046e790 0xc42046e7a8] [0xc42046e778 0xc42046e790 0xc42046e7a8] [0xc42046e788 0xc42046e7a0] [0xc36d60 0xc36d60] 0xc420c1a3c0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420dffea0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 21:13:16.602  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-3nzdq with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 21:13:16.624  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 21:13:16.757  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 21:13:16 GMT 2017]; root of context hierarchy\n2017-03-17 21:13:18.464  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 21:13:18.488  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 21:13:19.107  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 21:13:19.231  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-17 21:13:19.231  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 21:13:19.243  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 21:13:19.275  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-17 21:13:19.275  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 21:13:19.275  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 21:13:19.568  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 21:13:20.415  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 21:13:20.711  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 21:13:20.714  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 21:13:20.730  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-17 21:13:20.732  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 21:13:20.796  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - 00ce2e15-2bde-4602-9ac8-2176a1cdc837 this\n}\n\n2017-03-17 21:13:20.880  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-17 21:13:20.882  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.406 seconds (JVM running for 6.33)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 21:13:16.602  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-3nzdq with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 21:13:16.624  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 21:13:16.757  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 21:13:16 GMT 2017]; root of context hierarchy
    2017-03-17 21:13:18.464  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 21:13:18.488  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 21:13:19.107  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 21:13:19.231  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
    2017-03-17 21:13:19.231  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 21:13:19.243  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 21:13:19.275  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
    2017-03-17 21:13:19.275  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 21:13:19.275  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 21:13:19.568  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 21:13:20.415  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 21:13:20.711  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 21:13:20.714  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 21:13:20.730  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
    2017-03-17 21:13:20.732  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 21:13:20.796  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.14]:5701 - 00ce2e15-2bde-4602-9ac8-2176a1cdc837 this
    }

    2017-03-17 21:13:20.880  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
    2017-03-17 21:13:20.882  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.406 seconds (JVM running for 6.33)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421909c10>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-3t9c2\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  21:30:59 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  21:31:00 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3t9c2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  21:31:00 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  21:31:00 Global memtable on-heap threshold is enabled at 128MB\nINFO  21:31:00 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 21:31:00 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-3t9c2
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  21:30:59 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  21:31:00 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-3t9c2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  21:31:00 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  21:31:00 Global memtable on-heap threshold is enabled at 128MB
    INFO  21:31:00 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 21:31:00 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4239/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc4207d6ae0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-bj03c\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  22:26:33 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  22:26:34 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.12; broadcast_rpc_address=10.180.2.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bj03c}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  22:26:34 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  22:26:34 Global memtable on-heap threshold is enabled at 128MB\nINFO  22:26:34 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 22:26:34 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-bj03c
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  22:26:33 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  22:26:34 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.12; broadcast_rpc_address=10.180.2.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-bj03c}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  22:26:34 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  22:26:34 Global memtable on-heap threshold is enabled at 128MB
    INFO  22:26:34 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 22:26:34 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421780500>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 22:29:12.019  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-szzhr with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-17 22:29:12.030  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 22:29:12.204  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 22:29:12 GMT 2017]; root of context hierarchy\n2017-03-17 22:29:13.794  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 22:29:13.820  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 22:29:14.424  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 22:29:14.553  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]\n2017-03-17 22:29:14.554  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 22:29:14.567  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 22:29:14.601  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701\n2017-03-17 22:29:14.602  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 22:29:14.602  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 22:29:14.986  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 22:29:16.091  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 22:29:16.366  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 22:29:16.375  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 22:29:16.399  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING\n2017-03-17 22:29:16.405  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 22:29:16.457  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.15]:5701 - 1bf1c0eb-4d41-47cf-a3e3-d7251775e67b this\n}\n\n2017-03-17 22:29:16.534  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED\n2017-03-17 22:29:16.538  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.466 seconds (JVM running for 6.325)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 22:29:12.019  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-szzhr with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-17 22:29:12.030  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 22:29:12.204  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 22:29:12 GMT 2017]; root of context hierarchy
    2017-03-17 22:29:13.794  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 22:29:13.820  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 22:29:14.424  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 22:29:14.553  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.15]
    2017-03-17 22:29:14.554  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 22:29:14.567  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.15]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 22:29:14.601  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.15]:5701
    2017-03-17 22:29:14.602  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 22:29:14.602  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.3.15]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 22:29:14.986  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.15]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 22:29:16.091  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.3.15]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 22:29:16.366  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 22:29:16.375  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.15]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 22:29:16.399  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTING
    2017-03-17 22:29:16.405  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.15]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 22:29:16.457  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.15]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.15]:5701 - 1bf1c0eb-4d41-47cf-a3e3-d7251775e67b this
    }

    2017-03-17 22:29:16.534  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.15]:5701 [someGroup] [3.7.5] [10.180.3.15]:5701 is STARTED
    2017-03-17 22:29:16.538  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.466 seconds (JVM running for 6.325)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-352dp] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc4211e5320 exit status 1 <nil> <nil> true [0xc421310240 0xc421310260 0xc421310280] [0xc421310240 0xc421310260 0xc421310280] [0xc421310258 0xc421310278] [0xc36d60 0xc36d60] 0xc4212e9a40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-352dp] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc4211e5320 exit status 1 <nil> <nil> true [0xc421310240 0xc421310260 0xc421310280] [0xc421310240 0xc421310260 0xc421310280] [0xc421310258 0xc421310278] [0xc36d60 0xc36d60] 0xc4212e9a40 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4240/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42160e1c0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.12\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.12\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.12\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.12\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-hngb2\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  23:36:51 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  23:36:51 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.12; broadcast_rpc_address=10.180.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hngb2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  23:36:51 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  23:36:52 Global memtable on-heap threshold is enabled at 128MB\nINFO  23:36:52 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 23:36:52 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.12
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.12
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.12
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.12
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-hngb2
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  23:36:51 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  23:36:51 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.12; broadcast_rpc_address=10.180.3.12; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.12; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-hngb2}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  23:36:51 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  23:36:52 Global memtable on-heap threshold is enabled at 128MB
    INFO  23:36:52 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 23:36:52 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420ccf470>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-17 23:15:50.360  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hc7rv with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-17 23:15:50.368  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-17 23:15:50.533  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 23:15:50 GMT 2017]; root of context hierarchy\n2017-03-17 23:15:52.182  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-17 23:15:52.207  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-17 23:15:52.777  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-17 23:15:52.899  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]\n2017-03-17 23:15:52.900  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-17 23:15:52.911  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-17 23:15:52.944  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701\n2017-03-17 23:15:52.944  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-17 23:15:52.944  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-17 23:15:53.318  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-17 23:15:54.203  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-17 23:15:54.473  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-17 23:15:54.488  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-17 23:15:54.520  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING\n2017-03-17 23:15:54.526  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-17 23:15:54.558  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.8]:5701 - e7d05800-4ac1-443d-b889-45f6b6694672 this\n}\n\n2017-03-17 23:15:54.627  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED\n2017-03-17 23:15:54.632  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.137 seconds (JVM running for 6.269)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-17 23:15:50.360  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-hc7rv with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-17 23:15:50.368  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-17 23:15:50.533  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Fri Mar 17 23:15:50 GMT 2017]; root of context hierarchy
    2017-03-17 23:15:52.182  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-17 23:15:52.207  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-17 23:15:52.777  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-17 23:15:52.899  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.8]
    2017-03-17 23:15:52.900  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-17 23:15:52.911  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-17 23:15:52.944  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.8]:5701
    2017-03-17 23:15:52.944  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-17 23:15:52.944  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-17 23:15:53.318  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-17 23:15:54.203  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-17 23:15:54.473  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-17 23:15:54.488  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-17 23:15:54.520  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTING
    2017-03-17 23:15:54.526  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-17 23:15:54.558  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.8]:5701 - e7d05800-4ac1-443d-b889-45f6b6694672 this
    }

    2017-03-17 23:15:54.627  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.8]:5701 [someGroup] [3.7.5] [10.180.3.8]:5701 is STARTED
    2017-03-17 23:15:54.632  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.137 seconds (JVM running for 6.269)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.39.202 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v4rn0] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421617c80 exit status 1 <nil> <nil> true [0xc42049e8c0 0xc42049e8f8 0xc42049e948] [0xc42049e8c0 0xc42049e8f8 0xc42049e948] [0xc42049e8e0 0xc42049e918] [0xc36ea0 0xc36ea0] 0xc421007ec0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.39.202 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-v4rn0] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421617c80 exit status 1 <nil> <nil> true [0xc42049e8c0 0xc42049e8f8 0xc42049e948] [0xc42049e8c0 0xc42049e8f8 0xc42049e948] [0xc42049e8e0 0xc42049e918] [0xc36ea0 0xc36ea0] 0xc421007ec0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4241/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421b9e060>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 00:17:02.924  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-vgvk6 with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 00:17:02.939  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 00:17:03.036  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 00:17:03 GMT 2017]; root of context hierarchy\n2017-03-18 00:17:04.756  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 00:17:04.773  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 00:17:05.513  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 00:17:05.626  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.6]\n2017-03-18 00:17:05.627  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 00:17:05.638  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 00:17:05.671  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.6]:5701\n2017-03-18 00:17:05.671  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 00:17:05.671  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 00:17:05.994  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.6]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 00:17:06.862  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 00:17:07.170  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 00:17:07.174  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 00:17:07.183  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.6]:5701 [someGroup] [3.7.5] [10.180.2.6]:5701 is STARTING\n2017-03-18 00:17:07.186  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 00:17:07.214  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.6]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.6]:5701 - d492717b-bece-4ca4-9e67-f806e70a56a7 this\n}\n\n2017-03-18 00:17:07.288  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.6]:5701 [someGroup] [3.7.5] [10.180.2.6]:5701 is STARTED\n2017-03-18 00:17:07.292  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.337 seconds (JVM running for 6.3)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 00:17:02.924  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-vgvk6 with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-18 00:17:02.939  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 00:17:03.036  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 00:17:03 GMT 2017]; root of context hierarchy
    2017-03-18 00:17:04.756  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 00:17:04.773  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 00:17:05.513  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 00:17:05.626  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.6]
    2017-03-18 00:17:05.627  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 00:17:05.638  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.6]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 00:17:05.671  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.6]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.6]:5701
    2017-03-18 00:17:05.671  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.6]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 00:17:05.671  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.2.6]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 00:17:05.994  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.6]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 00:17:06.862  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.2.6]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 00:17:07.170  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.6]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 00:17:07.174  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.6]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 00:17:07.183  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.6]:5701 [someGroup] [3.7.5] [10.180.2.6]:5701 is STARTING
    2017-03-18 00:17:07.186  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.6]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 00:17:07.214  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.6]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.6]:5701 - d492717b-bece-4ca4-9e67-f806e70a56a7 this
    }

    2017-03-18 00:17:07.288  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.6]:5701 [someGroup] [3.7.5] [10.180.2.6]:5701 is STARTED
    2017-03-18 00:17:07.292  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.337 seconds (JVM running for 6.3)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421b5ea40>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-6ht3x\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  00:41:44 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  00:41:44 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.13; broadcast_rpc_address=10.180.2.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6ht3x}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  00:41:44 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  00:41:44 Global memtable on-heap threshold is enabled at 128MB\nINFO  00:41:44 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 00:41:44 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-6ht3x
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  00:41:44 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  00:41:44 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.13; broadcast_rpc_address=10.180.2.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-6ht3x}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  00:41:44 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  00:41:44 Global memtable on-heap threshold is enabled at 128MB
    INFO  00:41:44 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 00:41:44 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.149.155 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-mzphs] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc42133b8f0 exit status 1 <nil> <nil> true [0xc420f14688 0xc420f146d8 0xc420f14748] [0xc420f14688 0xc420f146d8 0xc420f14748] [0xc420f146d0 0xc420f14720] [0xc37850 0xc37850] 0xc4209c9e60 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://130.211.149.155 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-mzphs] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc42133b8f0 exit status 1 <nil> <nil> true [0xc420f14688 0xc420f146d8 0xc420f14748] [0xc420f14688 0xc420f146d8 0xc420f14748] [0xc420f146d0 0xc420f14720] [0xc37850 0xc37850] 0xc4209c9e60 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4242/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420798d80>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 01:22:56.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-b8lw6 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 01:22:56.550  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 01:22:56.644  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 01:22:56 GMT 2017]; root of context hierarchy\n2017-03-18 01:22:58.480  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 01:22:58.506  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 01:22:59.172  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 01:22:59.297  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]\n2017-03-18 01:22:59.298  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 01:22:59.311  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 01:22:59.348  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701\n2017-03-18 01:22:59.349  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 01:22:59.349  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 01:22:59.705  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 01:23:00.673  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 01:23:00.998  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 01:23:01.012  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 01:23:01.021  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING\n2017-03-18 01:23:01.024  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 01:23:01.049  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.9]:5701 - 0e3ba603-f08d-4849-b64e-879c06d4bdc9 this\n}\n\n2017-03-18 01:23:01.135  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED\n2017-03-18 01:23:01.139  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.698 seconds (JVM running for 6.633)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 01:22:56.532  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-b8lw6 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 01:22:56.550  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 01:22:56.644  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 01:22:56 GMT 2017]; root of context hierarchy
    2017-03-18 01:22:58.480  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 01:22:58.506  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 01:22:59.172  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 01:22:59.297  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.9]
    2017-03-18 01:22:59.298  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 01:22:59.311  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.9]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 01:22:59.348  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.9]:5701
    2017-03-18 01:22:59.349  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 01:22:59.349  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.9]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 01:22:59.705  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.9]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 01:23:00.673  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.9]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 01:23:00.998  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 01:23:01.012  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.9]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 01:23:01.021  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTING
    2017-03-18 01:23:01.024  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.9]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 01:23:01.049  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.9]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.9]:5701 - 0e3ba603-f08d-4849-b64e-879c06d4bdc9 this
    }

    2017-03-18 01:23:01.135  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.9]:5701 [someGroup] [3.7.5] [10.180.2.9]:5701 is STARTED
    2017-03-18 01:23:01.139  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.698 seconds (JVM running for 6.633)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42181fcf0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-77ltl\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  01:42:55 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  01:42:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.13; broadcast_rpc_address=10.180.2.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-77ltl}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  01:42:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  01:42:56 Global memtable on-heap threshold is enabled at 128MB\nINFO  01:42:56 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 01:42:56 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-77ltl
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  01:42:55 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  01:42:56 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.13; broadcast_rpc_address=10.180.2.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-77ltl}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  01:42:56 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  01:42:56 Global memtable on-heap threshold is enabled at 128MB
    INFO  01:42:56 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 01:42:56 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7dghr] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420f531d0 exit status 1 <nil> <nil> true [0xc420036dc8 0xc420036de0 0xc420036df8] [0xc420036dc8 0xc420036de0 0xc420036df8] [0xc420036dd8 0xc420036df0] [0xc37850 0xc37850] 0xc420d07da0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-7dghr] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420f531d0 exit status 1 <nil> <nil> true [0xc420036dc8 0xc420036de0 0xc420036df8] [0xc420036dc8 0xc420036de0 0xc420036df8] [0xc420036dd8 0xc420036df0] [0xc37850 0xc37850] 0xc420d07da0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4243/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-35227] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421996900 exit status 1 <nil> <nil> true [0xc4200951a0 0xc4200951b8 0xc4200951d0] [0xc4200951a0 0xc4200951b8 0xc4200951d0] [0xc4200951b0 0xc4200951c8] [0xc37850 0xc37850] 0xc420c76b40 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-35227] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421996900 exit status 1 <nil> <nil> true [0xc4200951a0 0xc4200951b8 0xc4200951d0] [0xc4200951a0 0xc4200951b8 0xc4200951d0] [0xc4200951b0 0xc4200951c8] [0xc37850 0xc37850] 0xc420c76b40 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420c4c0f0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.3.6\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.3.6\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.3.6\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-qsqzf\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  02:29:41 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  02:29:42 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-qsqzf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  02:29:42 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  02:29:42 Global memtable on-heap threshold is enabled at 128MB\nINFO  02:29:42 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 02:29:42 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.3.6
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.3.6
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.3.6
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.3.6
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-qsqzf
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  02:29:41 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  02:29:42 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.3.6; broadcast_rpc_address=10.180.3.6; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.3.6; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-qsqzf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  02:29:42 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  02:29:42 Global memtable on-heap threshold is enabled at 128MB
    INFO  02:29:42 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 02:29:42 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420b40220>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 02:42:20.146  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-471mk with PID 6 (/bootstrapper.jar started by root in /)\n2017-03-18 02:42:20.161  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 02:42:20.240  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 02:42:20 GMT 2017]; root of context hierarchy\n2017-03-18 02:42:21.929  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 02:42:21.948  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 02:42:22.563  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 02:42:22.676  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.14]\n2017-03-18 02:42:22.676  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 02:42:22.687  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 02:42:22.721  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.14]:5701\n2017-03-18 02:42:22.721  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 02:42:22.721  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 02:42:23.046  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 02:42:23.969  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.0.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 02:42:24.230  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 02:42:24.235  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 02:42:24.266  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.14]:5701 [someGroup] [3.7.5] [10.180.0.14]:5701 is STARTING\n2017-03-18 02:42:24.270  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 02:42:24.302  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.0.14]:5701 - d88f2c80-e607-4dcf-b1d1-9daf44663915 this\n}\n\n2017-03-18 02:42:24.355  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.14]:5701 [someGroup] [3.7.5] [10.180.0.14]:5701 is STARTED\n2017-03-18 02:42:24.358  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.17 seconds (JVM running for 6.057)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 02:42:20.146  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-471mk with PID 6 (/bootstrapper.jar started by root in /)
    2017-03-18 02:42:20.161  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 02:42:20.240  INFO 6 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 02:42:20 GMT 2017]; root of context hierarchy
    2017-03-18 02:42:21.929  INFO 6 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 02:42:21.948  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 02:42:22.563  INFO 6 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 02:42:22.676  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.0.14]
    2017-03-18 02:42:22.676  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 02:42:22.687  INFO 6 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.0.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 02:42:22.721  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.0.14]:5701
    2017-03-18 02:42:22.721  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 02:42:22.721  INFO 6 --- [           main] com.hazelcast.system                     : [10.180.0.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 02:42:23.046  INFO 6 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.0.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 02:42:23.969  INFO 6 --- [           main] com.hazelcast.instance.Node              : [10.180.0.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 02:42:24.230  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 02:42:24.235  INFO 6 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.0.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 02:42:24.266  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.14]:5701 [someGroup] [3.7.5] [10.180.0.14]:5701 is STARTING
    2017-03-18 02:42:24.270  INFO 6 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.0.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 02:42:24.302  INFO 6 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.0.14]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.0.14]:5701 - d88f2c80-e607-4dcf-b1d1-9daf44663915 this
    }

    2017-03-18 02:42:24.355  INFO 6 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.0.14]:5701 [someGroup] [3.7.5] [10.180.0.14]:5701 is STARTED
    2017-03-18 02:42:24.358  INFO 6 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.17 seconds (JVM running for 6.057)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4244/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-31bf7] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc421000ea0 exit status 1 <nil> <nil> true [0xc42029a998 0xc42029a9c8 0xc42029aa10] [0xc42029a998 0xc42029a9c8 0xc42029aa10] [0xc42029a9c0 0xc42029a9f0] [0xc37850 0xc37850] 0xc4210321e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-31bf7] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc421000ea0 exit status 1 <nil> <nil> true [0xc42029a998 0xc42029a9c8 0xc42029aa10] [0xc42029a998 0xc42029a9c8 0xc42029aa10] [0xc42029a9c0 0xc42029a9f0] [0xc37850 0xc37850] 0xc4210321e0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420d187b0>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 03:42:43.472  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9s4p6 with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 03:42:43.480  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 03:42:43.606  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 03:42:43 GMT 2017]; root of context hierarchy\n2017-03-18 03:42:45.294  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 03:42:45.324  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 03:42:46.148  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 03:42:46.269  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]\n2017-03-18 03:42:46.269  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 03:42:46.280  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 03:42:46.319  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701\n2017-03-18 03:42:46.320  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 03:42:46.320  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 03:42:46.659  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 03:42:47.559  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 03:42:47.845  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 03:42:47.847  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 03:42:47.857  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING\n2017-03-18 03:42:47.860  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 03:42:47.883  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.14]:5701 - 41757506-606b-4140-b0a2-a231f65e1bd0 this\n}\n\n2017-03-18 03:42:48.033  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED\n2017-03-18 03:42:48.037  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.652 seconds (JVM running for 6.629)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 03:42:43.472  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-9s4p6 with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 03:42:43.480  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 03:42:43.606  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 03:42:43 GMT 2017]; root of context hierarchy
    2017-03-18 03:42:45.294  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 03:42:45.324  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 03:42:46.148  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 03:42:46.269  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.14]
    2017-03-18 03:42:46.269  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 03:42:46.280  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.14]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 03:42:46.319  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.14]:5701
    2017-03-18 03:42:46.320  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 03:42:46.320  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.14]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 03:42:46.659  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.14]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 03:42:47.559  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.14]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 03:42:47.845  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 03:42:47.847  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.14]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 03:42:47.857  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTING
    2017-03-18 03:42:47.860  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.14]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 03:42:47.883  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.14]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.14]:5701 - 41757506-606b-4140-b0a2-a231f65e1bd0 this
    }

    2017-03-18 03:42:48.033  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.14]:5701 [someGroup] [3.7.5] [10.180.3.14]:5701 is STARTED
    2017-03-18 03:42:48.037  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.652 seconds (JVM running for 6.629)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42107e510>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.5\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.5\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.5\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.5\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-4xt67\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  03:34:26 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  03:34:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.5; broadcast_rpc_address=10.180.2.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4xt67}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  03:34:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  03:34:26 Global memtable on-heap threshold is enabled at 128MB\nINFO  03:34:26 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 03:34:26 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.5
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.5
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.5
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.5
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-4xt67
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  03:34:26 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  03:34:26 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.5; broadcast_rpc_address=10.180.2.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-4xt67}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  03:34:26 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  03:34:26 Global memtable on-heap threshold is enabled at 128MB
    INFO  03:34:26 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 03:34:26 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4245/ Multiple broken tests:

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc421086090>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 04:33:01.245  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-1j7zd with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 04:33:01.261  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 04:33:01.341  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 04:33:01 GMT 2017]; root of context hierarchy\n2017-03-18 04:33:03.086  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 04:33:03.113  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 04:33:03.739  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 04:33:03.879  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.8]\n2017-03-18 04:33:03.879  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 04:33:03.892  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 04:33:03.925  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701\n2017-03-18 04:33:03.925  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 04:33:03.925  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 04:33:04.295  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 04:33:05.207  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 04:33:05.551  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 04:33:05.556  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 04:33:05.567  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING\n2017-03-18 04:33:05.569  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 04:33:05.589  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.1.8]:5701 - 5a462a55-f859-4c6d-b5f7-5742b2d1b9d5 this\n}\n\n2017-03-18 04:33:05.712  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED\n2017-03-18 04:33:05.715  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.737 seconds (JVM running for 6.572)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 04:33:01.245  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-1j7zd with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 04:33:01.261  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 04:33:01.341  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 04:33:01 GMT 2017]; root of context hierarchy
    2017-03-18 04:33:03.086  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 04:33:03.113  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 04:33:03.739  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 04:33:03.879  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.1.8]
    2017-03-18 04:33:03.879  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 04:33:03.892  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.1.8]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 04:33:03.925  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.1.8]:5701
    2017-03-18 04:33:03.925  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 04:33:03.925  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.1.8]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 04:33:04.295  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.1.8]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 04:33:05.207  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.1.8]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 04:33:05.551  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 04:33:05.556  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.1.8]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 04:33:05.567  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTING
    2017-03-18 04:33:05.569  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.1.8]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 04:33:05.589  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.1.8]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.1.8]:5701 - 5a462a55-f859-4c6d-b5f7-5742b2d1b9d5 this
    }

    2017-03-18 04:33:05.712  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.1.8]:5701 [someGroup] [3.7.5] [10.180.1.8]:5701 is STARTED
    2017-03-18 04:33:05.715  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.737 seconds (JVM running for 6.572)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc420e3dc40>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.13\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.13\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.13\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-j64vf\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  04:53:05 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  04:53:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j64vf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  04:53:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  04:53:05 Global memtable on-heap threshold is enabled at 128MB\nINFO  04:53:05 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 04:53:05 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.13
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.13
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.13
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.13
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-j64vf
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  04:53:05 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  04:53:05 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.13; broadcast_rpc_address=10.180.1.13; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.13; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-j64vf}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  04:53:05 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  04:53:05 Global memtable on-heap threshold is enabled at 128MB
    INFO  04:53:05 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 04:53:05 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vwkdk] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420e04900 exit status 1 <nil> <nil> true [0xc420483210 0xc420483228 0xc420483240] [0xc420483210 0xc420483228 0xc420483240] [0xc420483220 0xc420483238] [0xc37850 0xc37850] 0xc422280540 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-vwkdk] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420e04900 exit status 1 <nil> <nil> true [0xc420483210 0xc420483228 0xc420483240] [0xc420483210 0xc420483228 0xc420483240] [0xc420483220 0xc420483238] [0xc37850 0xc37850] 0xc422280540 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4246/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc421c85060>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.1.10\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.1.10\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.1.10\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-fbsrk\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:06:10 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:06:10 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fbsrk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:06:10 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:06:10 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:06:10 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:06:10 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.1.10
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.1.10
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.1.10
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.1.10
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-fbsrk
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  06:06:10 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:06:10 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.1.10; broadcast_rpc_address=10.180.1.10; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.1.10; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-fbsrk}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:06:10 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:06:10 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:06:10 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:06:10 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-f1sgp] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420cc3a10 exit status 1 <nil> <nil> true [0xc420218ee0 0xc420218ef8 0xc420218f18] [0xc420218ee0 0xc420218ef8 0xc420218f18] [0xc420218ef0 0xc420218f10] [0xc37850 0xc37850] 0xc42168c420 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://35.184.188.207 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-f1sgp] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420cc3a10 exit status 1 <nil> <nil> true [0xc420218ee0 0xc420218ef8 0xc420218f18] [0xc420218ee0 0xc420218ef8 0xc420218f18] [0xc420218ef0 0xc420218f10] [0xc37850 0xc37850] 0xc42168c420 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420d23120>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 05:48:42.804  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-qb8wj with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 05:48:42.812  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 05:48:42.926  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 05:48:42 GMT 2017]; root of context hierarchy\n2017-03-18 05:48:44.603  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 05:48:44.623  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 05:48:45.409  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 05:48:45.560  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]\n2017-03-18 05:48:45.561  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 05:48:45.576  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 05:48:45.634  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701\n2017-03-18 05:48:45.635  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 05:48:45.635  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 05:48:46.042  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 05:48:46.889  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 05:48:47.178  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 05:48:47.184  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 05:48:47.192  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING\n2017-03-18 05:48:47.197  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 05:48:47.251  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.3.18]:5701 - bec76a3e-f1bb-4552-8357-32f21f717440 this\n}\n\n2017-03-18 05:48:47.331  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED\n2017-03-18 05:48:47.334  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.549 seconds (JVM running for 6.531)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 05:48:42.804  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-qb8wj with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 05:48:42.812  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 05:48:42.926  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 05:48:42 GMT 2017]; root of context hierarchy
    2017-03-18 05:48:44.603  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 05:48:44.623  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 05:48:45.409  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 05:48:45.560  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.3.18]
    2017-03-18 05:48:45.561  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 05:48:45.576  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.3.18]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 05:48:45.634  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.3.18]:5701
    2017-03-18 05:48:45.635  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 05:48:45.635  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.3.18]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 05:48:46.042  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.3.18]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 05:48:46.889  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.3.18]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 05:48:47.178  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 05:48:47.184  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.3.18]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 05:48:47.192  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTING
    2017-03-18 05:48:47.197  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.3.18]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 05:48:47.251  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.3.18]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.3.18]:5701 - bec76a3e-f1bb-4552-8357-32f21f717440 this
    }

    2017-03-18 05:48:47.331  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.3.18]:5701 [someGroup] [3.7.5] [10.180.3.18]:5701 is STARTED
    2017-03-18 05:48:47.334  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.549 seconds (JVM running for 6.531)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

k8s-github-robot commented 7 years ago

https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/logs/ci-kubernetes-e2e-gce-examples/4247/ Multiple broken tests:

Failed: [k8s.io] [Feature:Example] [k8s.io] CassandraStatefulSet should create statefulset {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:333
Expected error:
    <exec.CodeExitError>: {
        Err: {
            s: "error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.124.169 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-s75q8] []  <nil>  error: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n [] <nil> 0xc420b927e0 exit status 1 <nil> <nil> true [0xc420036e00 0xc420036e20 0xc420036e40] [0xc420036e00 0xc420036e20 0xc420036e40] [0xc420036e10 0xc420036e38] [0xc37850 0xc37850] 0xc420b7e1e0 <nil>}:\nCommand stdout:\n\nstderr:\nerror: the path \"examples/storage/cassandra/cassandra-service.yaml\" does not exist\n\nerror:\nexit status 1\n",
        },
        Code: 1,
    }
    error running &{/workspace/kubernetes/platforms/linux/amd64/kubectl [kubectl --server=https://104.197.124.169 --kubeconfig=/workspace/.kube/config create -f examples/storage/cassandra/cassandra-service.yaml --namespace=e2e-tests-examples-s75q8] []  <nil>  error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist
     [] <nil> 0xc420b927e0 exit status 1 <nil> <nil> true [0xc420036e00 0xc420036e20 0xc420036e40] [0xc420036e00 0xc420036e20 0xc420036e40] [0xc420036e10 0xc420036e38] [0xc37850 0xc37850] 0xc420b7e1e0 <nil>}:
    Command stdout:

    stderr:
    error: the path "examples/storage/cassandra/cassandra-service.yaml" does not exist

    error:
    exit status 1

not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2097

Issues about this test specifically: #36323 #36469 #38222

Failed: [k8s.io] [Feature:Example] [k8s.io] Cassandra should create and scale cassandra {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:261
Expected error:
    <*errors.errorString | 0xc42146b1d0>: {
        s: "Failed to find \"Starting listening for CQL clients\", last result: \"Starting Cassandra on 10.180.2.5\nCASSANDRA_CONF_DIR /etc/cassandra\nCASSANDRA_CFG /etc/cassandra/cassandra.yaml\nCASSANDRA_AUTO_BOOTSTRAP true\nCASSANDRA_BROADCAST_ADDRESS 10.180.2.5\nCASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.5\nCASSANDRA_CLUSTER_NAME 'Test Cluster'\nCASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC\nCASSANDRA_CONCURRENT_COMPACTORS\nCASSANDRA_CONCURRENT_READS\nCASSANDRA_CONCURRENT_WRITES\nCASSANDRA_COUNTER_CACHE_SIZE_IN_MB\nCASSANDRA_DC\nCASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd\nCASSANDRA_ENDPOINT_SNITCH SimpleSnitch\nCASSANDRA_GC_WARN_THRESHOLD_IN_MS\nCASSANDRA_INTERNODE_COMPRESSION\nCASSANDRA_KEY_CACHE_SIZE_IN_MB\nCASSANDRA_LISTEN_ADDRESS 10.180.2.5\nCASSANDRA_LISTEN_INTERFACE\nCASSANDRA_MEMTABLE_ALLOCATION_TYPE\nCASSANDRA_MEMTABLE_CLEANUP_THRESHOLD\nCASSANDRA_MEMTABLE_FLUSH_WRITERS\nCASSANDRA_MIGRATION_WAIT 1\nCASSANDRA_NUM_TOKENS 32\nCASSANDRA_RACK\nCASSANDRA_RING_DELAY 30000\nCASSANDRA_RPC_ADDRESS 0.0.0.0\nCASSANDRA_RPC_INTERFACE\nCASSANDRA_SEEDS cassandra-nh82q\nCASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider\nchanged ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra\nchanged ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra\nchanged ownership of '/etc/cassandra/jvm.options' from root to cassandra\nchanged ownership of '/etc/cassandra/logback.xml' from root to cassandra\nchanged ownership of '/etc/cassandra' from root to cassandra\nOpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory\n\nINFO  06:46:15 Configuration location: file:/etc/cassandra/cassandra.yaml\nINFO  06:46:15 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.5; broadcast_rpc_address=10.180.2.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-nh82q}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]\nINFO  06:46:15 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap\nINFO  06:46:15 Global memtable on-heap threshold is enabled at 128MB\nINFO  06:46:15 Global memtable off-heap threshold is enabled at 128MB\nException (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)\nERROR 06:46:15 Exception encountered during startup\norg.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider\nFatal configuration error; unable to start server.  See log for stacktrace.\n\tat org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]\n\tat org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]\n\"",
    }
    Failed to find "Starting listening for CQL clients", last result: "Starting Cassandra on 10.180.2.5
    CASSANDRA_CONF_DIR /etc/cassandra
    CASSANDRA_CFG /etc/cassandra/cassandra.yaml
    CASSANDRA_AUTO_BOOTSTRAP true
    CASSANDRA_BROADCAST_ADDRESS 10.180.2.5
    CASSANDRA_BROADCAST_RPC_ADDRESS 10.180.2.5
    CASSANDRA_CLUSTER_NAME 'Test Cluster'
    CASSANDRA_COMPACTION_THROUGHPUT_MB_PER_SEC
    CASSANDRA_CONCURRENT_COMPACTORS
    CASSANDRA_CONCURRENT_READS
    CASSANDRA_CONCURRENT_WRITES
    CASSANDRA_COUNTER_CACHE_SIZE_IN_MB
    CASSANDRA_DC
    CASSANDRA_DISK_OPTIMIZATION_STRATEGY ssd
    CASSANDRA_ENDPOINT_SNITCH SimpleSnitch
    CASSANDRA_GC_WARN_THRESHOLD_IN_MS
    CASSANDRA_INTERNODE_COMPRESSION
    CASSANDRA_KEY_CACHE_SIZE_IN_MB
    CASSANDRA_LISTEN_ADDRESS 10.180.2.5
    CASSANDRA_LISTEN_INTERFACE
    CASSANDRA_MEMTABLE_ALLOCATION_TYPE
    CASSANDRA_MEMTABLE_CLEANUP_THRESHOLD
    CASSANDRA_MEMTABLE_FLUSH_WRITERS
    CASSANDRA_MIGRATION_WAIT 1
    CASSANDRA_NUM_TOKENS 32
    CASSANDRA_RACK
    CASSANDRA_RING_DELAY 30000
    CASSANDRA_RPC_ADDRESS 0.0.0.0
    CASSANDRA_RPC_INTERFACE
    CASSANDRA_SEEDS cassandra-nh82q
    CASSANDRA_SEED_PROVIDER io.k8s.cassandra.KubernetesSeedProvider
    changed ownership of '/etc/cassandra/cassandra-env.sh' from root to cassandra
    changed ownership of '/etc/cassandra/cassandra.yaml' from root to cassandra
    changed ownership of '/etc/cassandra/jvm.options' from root to cassandra
    changed ownership of '/etc/cassandra/logback.xml' from root to cassandra
    changed ownership of '/etc/cassandra' from root to cassandra
    OpenJDK 64-Bit Server VM warning: Cannot open file /usr/local/apache-cassandra-3.9/logs/gc.log due to No such file or directory

    INFO  06:46:15 Configuration location: file:/etc/cassandra/cassandra.yaml
    INFO  06:46:15 Node configuration:[allocate_tokens_for_keyspace=null; authenticator=AllowAllAuthenticator; authorizer=AllowAllAuthorizer; auto_bootstrap=true; auto_snapshot=true; batch_size_fail_threshold_in_kb=50; batch_size_warn_threshold_in_kb=5; batchlog_replay_throttle_in_kb=1024; broadcast_address=10.180.2.5; broadcast_rpc_address=10.180.2.5; buffer_pool_use_heap_if_exhausted=true; cas_contention_timeout_in_ms=1000; cdc_enabled=false; cdc_free_space_check_interval_ms=250; cdc_raw_directory=null; cdc_total_space_in_mb=null; client_encryption_options=<REDACTED>; cluster_name=Test Cluster; column_index_cache_size_in_kb=2; column_index_size_in_kb=64; commit_failure_policy=stop; commitlog_compression=null; commitlog_directory=/cassandra_data/commitlog; commitlog_max_compression_buffers_in_pool=3; commitlog_periodic_queue_size=-1; commitlog_segment_size_in_mb=32; commitlog_sync=periodic; commitlog_sync_batch_window_in_ms=null; commitlog_sync_period_in_ms=10000; commitlog_total_space_in_mb=null; compaction_large_partition_warning_threshold_mb=100; compaction_throughput_mb_per_sec=16; concurrent_compactors=null; concurrent_counter_writes=32; concurrent_materialized_view_writes=32; concurrent_reads=32; concurrent_replicates=null; concurrent_writes=32; counter_cache_keys_to_save=2147483647; counter_cache_save_period=7200; counter_cache_size_in_mb=null; counter_write_request_timeout_in_ms=5000; credentials_cache_max_entries=1000; credentials_update_interval_in_ms=-1; credentials_validity_in_ms=2000; cross_node_timeout=false; data_file_directories=[Ljava.lang.String;@11dc3715; disk_access_mode=auto; disk_failure_policy=stop; disk_optimization_estimate_percentile=0.95; disk_optimization_page_cross_chance=0.1; disk_optimization_strategy=ssd; dynamic_snitch=true; dynamic_snitch_badness_threshold=0.1; dynamic_snitch_reset_interval_in_ms=600000; dynamic_snitch_update_interval_in_ms=100; enable_scripted_user_defined_functions=false; enable_user_defined_functions=false; enable_user_defined_functions_threads=true; encryption_options=null; endpoint_snitch=SimpleSnitch; file_cache_size_in_mb=null; gc_log_threshold_in_ms=200; gc_warn_threshold_in_ms=1000; hinted_handoff_disabled_datacenters=[]; hinted_handoff_enabled=true; hinted_handoff_throttle_in_kb=1024; hints_compression=null; hints_directory=/cassandra_data/hints; hints_flush_period_in_ms=10000; incremental_backups=false; index_interval=null; index_summary_capacity_in_mb=null; index_summary_resize_interval_in_minutes=60; initial_token=null; inter_dc_stream_throughput_outbound_megabits_per_sec=200; inter_dc_tcp_nodelay=false; internode_authenticator=null; internode_compression=all; internode_recv_buff_size_in_bytes=null; internode_send_buff_size_in_bytes=null; key_cache_keys_to_save=2147483647; key_cache_save_period=14400; key_cache_size_in_mb=null; listen_address=10.180.2.5; listen_interface=null; listen_interface_prefer_ipv6=false; listen_on_broadcast_address=false; max_hint_window_in_ms=10800000; max_hints_delivery_threads=2; max_hints_file_size_in_mb=128; max_mutation_size_in_kb=null; max_streaming_retries=3; max_value_size_in_mb=256; memtable_allocation_type=heap_buffers; memtable_cleanup_threshold=null; memtable_flush_writers=1; memtable_heap_space_in_mb=null; memtable_offheap_space_in_mb=null; min_free_space_per_drive_in_mb=50; native_transport_max_concurrent_connections=-1; native_transport_max_concurrent_connections_per_ip=-1; native_transport_max_frame_size_in_mb=256; native_transport_max_threads=128; native_transport_port=9042; native_transport_port_ssl=null; num_tokens=32; otc_coalescing_strategy=TIMEHORIZON; otc_coalescing_window_us=200; partitioner=org.apache.cassandra.dht.Murmur3Partitioner; permissions_cache_max_entries=1000; permissions_update_interval_in_ms=-1; permissions_validity_in_ms=2000; phi_convict_threshold=8.0; prepared_statements_cache_size_mb=null; range_request_timeout_in_ms=10000; read_request_timeout_in_ms=5000; request_scheduler=org.apache.cassandra.scheduler.NoScheduler; request_scheduler_id=null; request_scheduler_options=null; request_timeout_in_ms=10000; role_manager=CassandraRoleManager; roles_cache_max_entries=1000; roles_update_interval_in_ms=-1; roles_validity_in_ms=2000; row_cache_class_name=org.apache.cassandra.cache.OHCProvider; row_cache_keys_to_save=2147483647; row_cache_save_period=0; row_cache_size_in_mb=0; rpc_address=0.0.0.0; rpc_interface=null; rpc_interface_prefer_ipv6=false; rpc_keepalive=true; rpc_listen_backlog=50; rpc_max_threads=2147483647; rpc_min_threads=16; rpc_port=9160; rpc_recv_buff_size_in_bytes=null; rpc_send_buff_size_in_bytes=null; rpc_server_type=sync; saved_caches_directory=/cassandra_data/saved_caches; seed_provider=io.k8s.cassandra.KubernetesSeedProvider{seeds=cassandra-nh82q}; server_encryption_options=<REDACTED>; snapshot_before_compaction=false; ssl_storage_port=7001; sstable_preemptive_open_interval_in_mb=50; start_native_transport=true; start_rpc=false; storage_port=7000; stream_throughput_outbound_megabits_per_sec=200; streaming_socket_timeout_in_ms=86400000; thrift_framed_transport_size_in_mb=15; thrift_max_message_length_in_mb=16; thrift_prepared_statements_cache_size_mb=null; tombstone_failure_threshold=100000; tombstone_warn_threshold=1000; tracetype_query_ttl=86400; tracetype_repair_ttl=604800; transparent_data_encryption_options=org.apache.cassandra.config.TransparentDataEncryptionOptions@69930714; trickle_fsync=false; trickle_fsync_interval_in_kb=10240; truncate_request_timeout_in_ms=60000; unlogged_batch_across_partitions_warn_threshold=10; user_defined_function_fail_timeout=1500; user_defined_function_warn_timeout=500; user_function_timeout_policy=die; windows_timer_interval=1; write_request_timeout_in_ms=2000]
    INFO  06:46:15 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
    INFO  06:46:15 Global memtable on-heap threshold is enabled at 128MB
    INFO  06:46:15 Global memtable off-heap threshold is enabled at 128MB
    Exception (org.apache.cassandra.exceptions.ConfigurationException) encountered during startup: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782)
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730)
    ERROR 06:46:15 Exception encountered during startup
    org.apache.cassandra.exceptions.ConfigurationException: io.k8s.cassandra.KubernetesSeedProvider
    Fatal configuration error; unable to start server.  See log for stacktrace.
        at org.apache.cassandra.config.DatabaseDescriptor.applyConfig(DatabaseDescriptor.java:782) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.config.DatabaseDescriptor.<clinit>(DatabaseDescriptor.java:125) ~[apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:576) [apache-cassandra-3.9.jar:3.9]
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:730) [apache-cassandra-3.9.jar:3.9]
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:250

Issues about this test specifically: #27978 #28817 #39574

Failed: [k8s.io] [Feature:Example] [k8s.io] Hazelcast should create and scale hazelcast {Kubernetes e2e suite}

/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:571
Expected error:
    <*errors.errorString | 0xc420ca7840>: {
        s: "Failed to find \"Members [2]\", last result: \"2017-03-18 07:01:40.258  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-6w7sl with PID 5 (/bootstrapper.jar started by root in /)\n2017-03-18 07:01:40.265  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default\n2017-03-18 07:01:40.339  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 07:01:40 GMT 2017]; root of context hierarchy\n2017-03-18 07:01:42.353  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup\n2017-03-18 07:01:42.371  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..\n2017-03-18 07:01:42.998  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.\n2017-03-18 07:01:43.109  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.19]\n2017-03-18 07:01:43.109  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.\n2017-03-18 07:01:43.121  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true\n2017-03-18 07:01:43.154  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.19]:5701\n2017-03-18 07:01:43.154  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.\n2017-03-18 07:01:43.154  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1\n2017-03-18 07:01:43.491  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.19]:5701 [someGroup] [3.7.5] Backpressure is disabled\n2017-03-18 07:01:44.533  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner\n2017-03-18 07:01:44.858  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads\n2017-03-18 07:01:44.860  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)\n2017-03-18 07:01:44.881  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.19]:5701 [someGroup] [3.7.5] [10.180.2.19]:5701 is STARTING\n2017-03-18 07:01:44.882  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads\n2017-03-18 07:01:44.920  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.19]:5701 [someGroup] [3.7.5] \n\n\nMembers [1] {\n\tMember [10.180.2.19]:5701 - 58ce8579-4998-4de5-94ae-79da0eac76fd this\n}\n\n2017-03-18 07:01:45.012  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.19]:5701 [someGroup] [3.7.5] [10.180.2.19]:5701 is STARTED\n2017-03-18 07:01:45.024  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.782 seconds (JVM running for 6.719)\n\"",
    }
    Failed to find "Members [2]", last result: "2017-03-18 07:01:40.258  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Starting Application on hazelcast-944810110-6w7sl with PID 5 (/bootstrapper.jar started by root in /)
    2017-03-18 07:01:40.265  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : No active profile set, falling back to default profiles: default
    2017-03-18 07:01:40.339  INFO 5 --- [           main] s.c.a.AnnotationConfigApplicationContext : Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@14514713: startup date [Sat Mar 18 07:01:40 GMT 2017]; root of context hierarchy
    2017-03-18 07:01:42.353  INFO 5 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Registering beans for JMX exposure on startup
    2017-03-18 07:01:42.371  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Asking k8s registry at https://kubernetes.default.svc.cluster.local..
    2017-03-18 07:01:42.998  INFO 5 --- [           main] c.g.p.h.HazelcastDiscoveryController     : Found 1 pods running Hazelcast.
    2017-03-18 07:01:43.109  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [10.180.2.19]
    2017-03-18 07:01:43.109  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Prefer IPv4 stack is true.
    2017-03-18 07:01:43.121  INFO 5 --- [           main] c.h.instance.DefaultAddressPicker        : [LOCAL] [someGroup] [3.7.5] Picked [10.180.2.19]:5701, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5701], bind any local is true
    2017-03-18 07:01:43.154  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Hazelcast 3.7.5 (20170124 - 111f332) starting at [10.180.2.19]:5701
    2017-03-18 07:01:43.154  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved.
    2017-03-18 07:01:43.154  INFO 5 --- [           main] com.hazelcast.system                     : [10.180.2.19]:5701 [someGroup] [3.7.5] Configured Hazelcast Serialization version : 1
    2017-03-18 07:01:43.491  INFO 5 --- [           main] c.h.s.i.o.impl.BackpressureRegulator     : [10.180.2.19]:5701 [someGroup] [3.7.5] Backpressure is disabled
    2017-03-18 07:01:44.533  INFO 5 --- [           main] com.hazelcast.instance.Node              : [10.180.2.19]:5701 [someGroup] [3.7.5] Creating TcpIpJoiner
    2017-03-18 07:01:44.858  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.19]:5701 [someGroup] [3.7.5] Starting 2 partition threads
    2017-03-18 07:01:44.860  INFO 5 --- [           main] c.h.s.i.o.impl.OperationExecutorImpl     : [10.180.2.19]:5701 [someGroup] [3.7.5] Starting 3 generic threads (1 dedicated for priority tasks)
    2017-03-18 07:01:44.881  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.19]:5701 [someGroup] [3.7.5] [10.180.2.19]:5701 is STARTING
    2017-03-18 07:01:44.882  INFO 5 --- [           main] c.h.n.t.n.NonBlockingIOThreadingModel    : [10.180.2.19]:5701 [someGroup] [3.7.5] TcpIpConnectionManager configured with Non Blocking IO-threading model: 3 input threads and 3 output threads
    2017-03-18 07:01:44.920  INFO 5 --- [           main] com.hazelcast.cluster.impl.TcpIpJoiner   : [10.180.2.19]:5701 [someGroup] [3.7.5] 

    Members [1] {
        Member [10.180.2.19]:5701 - 58ce8579-4998-4de5-94ae-79da0eac76fd this
    }

    2017-03-18 07:01:45.012  INFO 5 --- [           main] com.hazelcast.core.LifecycleService      : [10.180.2.19]:5701 [someGroup] [3.7.5] [10.180.2.19]:5701 is STARTED
    2017-03-18 07:01:45.024  INFO 5 --- [           main] com.github.pires.hazelcast.Application   : Started Application in 5.782 seconds (JVM running for 6.719)
    "
not to have occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/examples.go:569

Issues about this test specifically: #27850 #30672 #33271

Failed: Test {e2e.go}

error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Example\]: exit status 1

Issues about this test specifically: #33361 #38663 #39788 #39877 #40371 #40469 #40478 #40483 #40668 #41048 #43025